-- Logs begin at Mon 2022-02-21 00:59:59 UTC, end at Mon 2022-02-21 01:53:54 UTC. -- Feb 21 01:24:31.968436 dv-cinder-813229-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 21 01:24:31.976290 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 01:24:31 2022] *** Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: nodename: dv-cinder-813229-6-iscsi Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: machine: x86_64 Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: clock source: unix Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: pcre jit disabled Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: detected number of CPU cores: 4 Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: current working directory: / Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: detected binary path: /usr/bin/uwsgi-core Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: your processes number limit is 47680 Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: your memory page size is 4096 bytes Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: detected max file descriptor number: 2048 Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: lock engine: pthread robust mutexes Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: thunder lock: enabled Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 21 01:24:31.982239 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 01:24:32.032986 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: Python main interpreter initialized at 0x556d114a19c0 Feb 21 01:24:32.032986 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: python threads support enabled Feb 21 01:24:32.032986 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: your server socket listen backlog is limited to 100 connections Feb 21 01:24:32.032986 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: your mercy for graceful operations on workers is 90 seconds Feb 21 01:24:32.033320 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 01:24:32.033526 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: *** Operational MODE: preforking *** Feb 21 01:24:32.033708 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: *** uWSGI is running in multiple interpreter mode *** Feb 21 01:24:32.033708 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: spawned uWSGI master process (pid: 79354) Feb 21 01:24:32.036826 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: spawned uWSGI worker 1 (pid: 79370, cores: 1) Feb 21 01:24:32.036826 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: spawned uWSGI worker 2 (pid: 79371, cores: 1) Feb 21 01:24:32.033910 dv-cinder-813229-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 21 01:24:32.037800 dv-cinder-813229-6-iscsi devstack@keystone.service[79354]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 01:24:37.917489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:24:37.917489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: from cryptography.utils import int_from_bytes Feb 21 01:24:37.918715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:24:37.918715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: from cryptography.utils import int_from_bytes Feb 21 01:24:37.926429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:24:37.926429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: from cryptography.utils import int_from_bytes Feb 21 01:24:37.927342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:24:37.927342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: from cryptography.utils import int_from_bytes Feb 21 01:24:37.965473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 01:24:37.965894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 01:24:37.966251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] command line args: [] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 01:24:37.966681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 01:24:37.967010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ================================================================================ {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 01:24:37.967410 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] admin_token = **** {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.967800 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] config_dir = [] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.968123 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.968440 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] config_source = [] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.968770 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] debug = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.969215 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.969972 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.971095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.971512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.971922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.972308 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] list_limit = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.972642 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] log_config_append = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.972966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.973289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] log_dir = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.973688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] log_file = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.974110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.974555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.974988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.975169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 01:24:37.975505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.975741 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 01:24:37.975871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.976151 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.976352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] command line args: [] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 01:24:37.976591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.976915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 01:24:37.977026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.977370 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.977473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ================================================================================ {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 01:24:37.977782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.977984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] admin_token = **** {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.978239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.978583 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.978703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] config_dir = [] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.979013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.979116 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.979418 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] config_source = [] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.979519 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.979824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] debug = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.979920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.980249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.980625 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.980794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.981002 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] publish_errors = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.981339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.981439 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.981744 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.981980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.982082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.982491 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.982777 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.982999 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] list_limit = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.983327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] log_config_append = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.983433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.983739 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.984045 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] standard_threads = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.984157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] log_dir = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.984448 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] log_file = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.984749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.984973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.985370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.985464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.986400 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.986513 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.986748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] use_journal = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.987022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] use_json = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.987160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.987374 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] use_stderr = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.987601 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.987694 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] use_syslog = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.987993 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.988089 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.988465 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.988657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.988888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.989169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.989336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.989663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.989839 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.990097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.990382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.990614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.990911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.991013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.991364 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.991475 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.991794 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.991988 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.992225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.992499 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.992645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.992981 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.993168 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.993410 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.993745 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.994093 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.994291 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.994578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.994751 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] publish_errors = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.994998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.995258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.995429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.995789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.995883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.996172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.996272 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.996589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.996771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.997023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.997356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.997451 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.997803 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.997930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] standard_threads = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.998235 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.998471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.998656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.998987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.999117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:37.999393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:37.999551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:38.000069 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.000268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] use_journal = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:38.000494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.000704 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] use_json = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:38.000944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.001173 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] use_stderr = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:38.001932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.002148 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] use_syslog = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:38.002364 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.002696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:24:38.002798 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.003119 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.003323 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.003542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.003829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.003924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.004280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.004445 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.004734 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.004965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.005150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.005482 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.005600 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.005883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.006109 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.006415 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.006655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.006825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.007167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.007259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.007594 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.007772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.008007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.008284 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.008454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.008785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.009001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.009202 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.009494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.009588 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.009932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.010082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.010363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.010621 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.010786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.011130 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.011240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.011538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.011769 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.011962 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.012279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.012375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.012678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.012889 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.013110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.013411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.013504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.013845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.013999 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.014276 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.014548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.014717 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.015055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.015204 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.015464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.015738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.015877 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.016226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.016390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.016690 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.016927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.017291 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.017385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.017718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.017847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.018151 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.018521 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.018743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.018970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.019310 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.019664 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.019881 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.020115 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.020470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.020767 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.020915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.021261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.021610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.021756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.022051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.022422 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.022632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.022848 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.023208 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.023477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.023627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.023978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.024341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.024487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.024776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.025043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.025192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.025544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.025695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.025973 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.026277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.026371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.026720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.026831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.027134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.027374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.027574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.027878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.027981 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.028315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.028467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.028740 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.028968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.029181 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.029472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.029577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.029939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.030128 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.030420 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.030672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.030859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.031200 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] auth.external = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.031312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.031618 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.031798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.032112 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.032314 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.032592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.032866 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.032961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] auth.password = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.033313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] auth.token = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.033424 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.033739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.034000 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.034179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.034554 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.034648 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.034959 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.035160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.035405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.035730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.035826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.036150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.036317 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.036578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] credential.caching = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.036846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.037014 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.037363 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.037459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.037789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.037942 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.038245 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.038501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.038673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.039015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.039147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.039464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.039648 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.039913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.040174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.040352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.040686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.040792 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.041175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.041272 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.041639 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.041736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.042084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.042265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.042609 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.042719 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.043088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.043184 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.043570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.043666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] federation.caching = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.044027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.044131 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.044501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.044597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.044959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.045054 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.045408 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.045514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.045872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.046100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.046466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.046577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.046948 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.047045 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.047401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.047507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.047866 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.047963 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.048862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.048959 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.049315 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.049422 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.049782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.049879 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.caching = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.050259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.050629 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.051060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.051440 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.051607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.051931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.052180 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.052400 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.052705 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.052875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.053225 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.053361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.053736 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.053841 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.054239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.054355 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.054718 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.054815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.055174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.055271 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.055620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.055726 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.056076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.056247 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.056578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.056859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.057085 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.057434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.057587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.057958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.058225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.058485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.058757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.059023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.059217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.059536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.059634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.060008 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.060103 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.060427 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.060636 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.060867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.061143 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.061299 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.061638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] auth.external = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.061814 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.062065 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.062332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.062610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.062903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.063001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.063365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.063479 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.064354 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.064615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] auth.password = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.064771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.065114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] auth.token = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.065223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.065563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.065711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.065991 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.066250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.066460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.066784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.066882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.067209 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.067355 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.067639 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.067868 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.068078 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.068409 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.068505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.068825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.068990 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.069262 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.069500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] credential.caching = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.069695 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.070022 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.070118 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.070470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.070629 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.070915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.071168 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.071354 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.071693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.071788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.072117 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.072292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.072559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.072792 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.073001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.073324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.073450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.073795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.073979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.074228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.074507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.074693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.075066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.075170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.075477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.075753 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.075929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.076287 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.076447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.076727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.077013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.077109 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.077452 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.077627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.077896 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.078239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.078336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.078660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.078842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] federation.caching = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.079082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.079422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.079518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.079866 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.080042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.080309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.080595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.080730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.081088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.081258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.081526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.081809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.081957 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.082343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.082530 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.082931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.083095 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.083369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.083644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.083787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.084144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.084324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.084601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.084863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.085033 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.085398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.085547 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.085824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.086087 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.caching = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.086284 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.086634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.086799 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.087065 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.087348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.087444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.087817 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.088183 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.088517 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.088976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.089423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] resource.caching = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.089876 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.090353 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.090798 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.091281 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.091760 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.092201 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.092650 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.093096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.093538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.093987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] role.caching = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.094481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] role.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.094944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.095396 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.095844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.096326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.096795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.097354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.097545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.097702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.098086 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.098406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.098554 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.098937 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.099096 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.099381 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.099666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.099816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.100178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.100368 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.100629 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.100942 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.101050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.101448 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.101687 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.101996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.102094 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.102479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.102699 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.102933 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.103257 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.103354 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.103705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.103908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.104139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.104449 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.104545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.104910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.105057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.105343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.105600 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.105783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.106124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.106298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.106688 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.106784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.107139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.107288 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.107588 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.107786 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.108034 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.108297 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.108455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.108804 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.108930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.109237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.109430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.109669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] token.caching = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.109958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.110054 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.110449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.111063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.111384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.111576 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.111840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.112100 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.112282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.112624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.112721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.113050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.113403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.113563 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.113851 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.114072 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.114300 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.114649 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.114759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.115071 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.115269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.115511 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.115772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.115963 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.116303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.116398 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.116721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.116874 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.117249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.117345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.117699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.connection = **** {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.117851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.118138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.118393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.118600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.118904 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.119000 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.119378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.119474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.119788 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.119988 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.120223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.120509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.120616 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.120962 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.121087 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.121397 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.121582 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.121826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.122111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.122282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.122649 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.122762 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.123084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.123255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.123517 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.123779 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.123969 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.124291 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.124387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.124713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.125126 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.125393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.125637 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.125731 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 01:24:38.126102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.127032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.127436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.127824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.128208 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.128581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.129001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.129378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.129767 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.130145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.130544 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.130933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.131318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.131705 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.132109 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.132494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.132863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.133249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.133625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.134001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.134414 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.134793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.135177 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.135563 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.135940 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.136333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.136720 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.137105 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.137479 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.137861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.138304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.138690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.139085 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.139465 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.139842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.140220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] resource.caching = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.140609 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.140995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.141382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.141790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.142184 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.142595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.142980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.143374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.143754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.144126 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] role.caching = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.144510 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] role.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.144887 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.145274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.145672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.146067 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.146495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.146883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.147268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.147654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.148056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.148429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.148814 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.149198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.149584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.149967 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.150596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.150974 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.151364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.151756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.152145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.152531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.152932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.153327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.153718 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.154098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.154501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.154879 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.155264 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.155663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.156057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.156444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.156817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.157189 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.158099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.158501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] token.caching = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.158882 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.159272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.159647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.160042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.160572 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.160982 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.161372 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.161755 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.162144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.162540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.162935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.163306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.163690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.164078 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.164447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.164826 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.165290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.165689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.connection = **** {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.166084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.166500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.166878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.167254 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.167680 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.168146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.168455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.168663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.168895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.169175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.169273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.169654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.170030 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.170435 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.170808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.171192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.171581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.171965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.172333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.172711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.173141 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:24:38.173983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 01:24:38.179907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.200980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.201415 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.201790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.209560 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.209907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.211164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.230697 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.231119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.269139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.271571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.322734 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.323129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.323503 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.323881 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.396437 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.396668 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.396916 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.397171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.397325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.397659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.397772 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.398061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.398262 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.398491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.398746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.399092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.425810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.426251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.426547 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.426656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.426969 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.427162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.427393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.427667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.427768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.428083 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.428240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.428585 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.428931 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.429276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.441477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.442445 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.455874 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.456148 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.456509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.456632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.456927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.457129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.457345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.457616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.457715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.458055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.458167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.458556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.458738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.459038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79371) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:24:38.477272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.477721 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 01:24:38.478228 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.478568 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.478677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 01:24:38.478955 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 01:24:38.479204 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.479509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.479754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.479853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 01:24:38.480439 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.480541 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.480879 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.481061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.481331 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.481690 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.492798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.493239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.493365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.493721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.493894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.494187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.494464 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.494682 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.503655 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.503820 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.507318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.507598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.507910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.508091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.508468 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.508573 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.508947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.509097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.509416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.509654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.509868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.510179 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.510309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.510702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.510819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.511148 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.511340 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.511611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.511873 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.512066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.512429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.512831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.539401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.541982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.542408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.543338 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.545100 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.545516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.548542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.548946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.549336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.552030 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.552457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.552869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.557428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.557843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.560739 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.561169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.562589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.562984 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.563376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.564340 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.564722 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.565101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.565477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.565870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.567598 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.568025 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.568439 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.568850 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.569275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.569685 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.570084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.570507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.585332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.585736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.589354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.589771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.590664 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.594356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.594760 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.594911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.598854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.599286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.600216 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.603914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.604691 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.607922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.608328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.608716 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.608978 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.609197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.609599 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.609992 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.613765 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.614218 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.614654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.615073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.615508 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.615921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.631293 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.631699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.632069 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.632440 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.636152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.636615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.637029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.637438 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.640702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.642525 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.642909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.645914 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.646028 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.646477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.646991 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.647377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.647761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.648476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.648900 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.652043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.652458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.652887 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.653326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.653861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.661886 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.662325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.662713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.663114 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.663488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.663878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.664276 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.668562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.669001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.669416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.669836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.670289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.670705 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.671124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.685092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.688513 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.691892 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.692538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.694232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.695564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.699046 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.700820 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.702618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.798786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.799274 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.799667 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.805309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.805844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.807329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.809179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.812426 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.812824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.813212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.813594 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.814883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.816606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.819872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.820302 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.820722 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.821132 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.824003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.824403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.824790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.830903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.831337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.831748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.833003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.833389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.833781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.834155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.834554 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.834950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.835337 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.835816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.836197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.836576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.836965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.837385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.837812 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.838193 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.841846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79371) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:24:38.842312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.842736 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.843145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.843551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.843964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.844391 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.844798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.845322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.845779 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.846233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.846656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.847060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.847457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79371) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:24:38.878255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d114a19c0 pid: 79370 (default app) Feb 21 01:24:38.881895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c97ba1-5888-4992-8b0d-e32cacf5cc1f None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:38.882338 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c97ba1-5888-4992-8b0d-e32cacf5cc1f None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:38.882727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c97ba1-5888-4992-8b0d-e32cacf5cc1f None None] PATH_INFO: `/v3` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:38.887018 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d114a19c0 pid: 79371 (default app) Feb 21 01:24:38.887684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 791 bytes} [Mon Feb 21 01:24:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:47.189807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c462c1-c2dd-4b60-b5c8-457b5c70ddd3 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:47.190370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c462c1-c2dd-4b60-b5c8-457b5c70ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:47.190465 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c462c1-c2dd-4b60-b5c8-457b5c70ddd3 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:47.195342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:24:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:24:47.200523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9aca6-1d5a-4e97-9799-8f03ee1439a1 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:47.201005 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9aca6-1d5a-4e97-9799-8f03ee1439a1 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:47.201097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9aca6-1d5a-4e97-9799-8f03ee1439a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:47.230975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG oslo_db.sqlalchemy.engines [None req-c6f9aca6-1d5a-4e97-9799-8f03ee1439a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:24:47.413738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG passlib.handlers.bcrypt [None req-c6f9aca6-1d5a-4e97-9799-8f03ee1439a1 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79370) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 21 01:24:47.414071 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG passlib.handlers.bcrypt [None req-c6f9aca6-1d5a-4e97-9799-8f03ee1439a1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79370) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 21 01:24:47.468813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c6f9aca6-1d5a-4e97-9799-8f03ee1439a1 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:47.470970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c6f9aca6-1d5a-4e97-9799-8f03ee1439a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:47.592669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 2/3] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:24:47.771054 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c462c1-c2dd-4b60-b5c8-457b5c70ddd3 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:47.803874 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG oslo_db.sqlalchemy.engines [None req-26c462c1-c2dd-4b60-b5c8-457b5c70ddd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:24:47.929088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c462c1-c2dd-4b60-b5c8-457b5c70ddd3 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:47.933297 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c63c4-e78a-4598-b45e-4cdaeb0b7539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:47.933947 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c63c4-e78a-4598-b45e-4cdaeb0b7539 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:47.934248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c63c4-e78a-4598-b45e-4cdaeb0b7539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:47.934522 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c63c4-e78a-4598-b45e-4cdaeb0b7539 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:47.942400 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c63c4-e78a-4598-b45e-4cdaeb0b7539 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:47.993008 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f63c63c4-e78a-4598-b45e-4cdaeb0b7539 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 21 01:24:47.993348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c63c4-e78a-4598-b45e-4cdaeb0b7539 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:48.002688 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:24:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:24:48.008505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9aca6-1d5a-4e97-9799-8f03ee1439a1 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:48.022567 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9aca6-1d5a-4e97-9799-8f03ee1439a1 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:48.026849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf1d27-599e-416a-b42a-914300377e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:48.027935 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf1d27-599e-416a-b42a-914300377e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:48.028220 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf1d27-599e-416a-b42a-914300377e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:48.028500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf1d27-599e-416a-b42a-914300377e81 admin admin] PATH_INFO: `/v3/projects/442aa4692fdc4c9cbacda48f2343b2fa` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:48.029995 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf1d27-599e-416a-b42a-914300377e81 admin admin] RBAC: Authorizing `identity:get_project(project_id=442aa4692fdc4c9cbacda48f2343b2fa)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:48.082892 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c1bf1d27-599e-416a-b42a-914300377e81 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 21 01:24:48.083234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf1d27-599e-416a-b42a-914300377e81 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:48.087836 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 3/5] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:24:48 2022] GET /identity/v3/projects/442aa4692fdc4c9cbacda48f2343b2fa => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:50.361482 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f951b-cbd0-4280-a18d-183eb1ba756b None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:50.361992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f951b-cbd0-4280-a18d-183eb1ba756b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:50.361992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f951b-cbd0-4280-a18d-183eb1ba756b None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:50.366484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 3/6] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:24:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:24:50.371827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd51a8-8bc6-48b6-a17e-6021ae7fbc90 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:50.372219 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd51a8-8bc6-48b6-a17e-6021ae7fbc90 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:50.372375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd51a8-8bc6-48b6-a17e-6021ae7fbc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:50.391036 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-eefd51a8-8bc6-48b6-a17e-6021ae7fbc90 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:50.392535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-eefd51a8-8bc6-48b6-a17e-6021ae7fbc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:50.400396 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:24:50.423880 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f951b-cbd0-4280-a18d-183eb1ba756b None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:50.435761 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f951b-cbd0-4280-a18d-183eb1ba756b None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:50.439889 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809b2bb-6cde-441e-a973-0650c007b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:50.440523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809b2bb-6cde-441e-a973-0650c007b38a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:50.440797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809b2bb-6cde-441e-a973-0650c007b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:50.441067 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809b2bb-6cde-441e-a973-0650c007b38a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:50.448607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809b2bb-6cde-441e-a973-0650c007b38a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:50.450402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809b2bb-6cde-441e-a973-0650c007b38a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:50.459155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:24:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:24:50.464401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd51a8-8bc6-48b6-a17e-6021ae7fbc90 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:50.473627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd51a8-8bc6-48b6-a17e-6021ae7fbc90 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:50.477933 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5a66-d6c6-4fcb-8ff1-ab017294e6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:50.478866 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5a66-d6c6-4fcb-8ff1-ab017294e6bf admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:50.479147 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5a66-d6c6-4fcb-8ff1-ab017294e6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:50.479416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5a66-d6c6-4fcb-8ff1-ab017294e6bf admin admin] PATH_INFO: `/v3/users/100e11f767f7472887d51a9dc7231480` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:50.480811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d5a66-d6c6-4fcb-8ff1-ab017294e6bf admin admin] RBAC: Authorizing `identity:get_user(user_id=100e11f767f7472887d51a9dc7231480)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:50.482669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d5a66-d6c6-4fcb-8ff1-ab017294e6bf admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:50.484234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 5/9] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:24:50 2022] GET /identity/v3/users/100e11f767f7472887d51a9dc7231480 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:24:52.837158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25053-62ce-4a4b-afd3-37d3a8941645 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:52.837692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25053-62ce-4a4b-afd3-37d3a8941645 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:52.837692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25053-62ce-4a4b-afd3-37d3a8941645 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:52.839503 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:52.845265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcdcc4-25d0-4192-8e7b-3c101179fb58 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:52.845688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcdcc4-25d0-4192-8e7b-3c101179fb58 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:52.845818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcdcc4-25d0-4192-8e7b-3c101179fb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:52.863015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-1cdcdcc4-25d0-4192-8e7b-3c101179fb58 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:52.864163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1cdcdcc4-25d0-4192-8e7b-3c101179fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:52.871523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 6/11] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:24:52.874642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26299cff-aa8e-4f8c-bc92-99f56abef3d2 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:52.875201 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26299cff-aa8e-4f8c-bc92-99f56abef3d2 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:52.875481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26299cff-aa8e-4f8c-bc92-99f56abef3d2 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:52.877227 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 6/12] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:52.882329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d3bf-4d5b-4cec-b894-57f5de249128 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:52.882621 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d3bf-4d5b-4cec-b894-57f5de249128 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:52.882904 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d3bf-4d5b-4cec-b894-57f5de249128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:52.894788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26299cff-aa8e-4f8c-bc92-99f56abef3d2 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:52.900890 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-00f1d3bf-4d5b-4cec-b894-57f5de249128 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:52.902066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-00f1d3bf-4d5b-4cec-b894-57f5de249128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:52.906495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26299cff-aa8e-4f8c-bc92-99f56abef3d2 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:52.910281 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 7/13] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:24:52.911797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a2360-1c6a-4ce0-a88e-27aff91a38dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:52.912580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a2360-1c6a-4ce0-a88e-27aff91a38dc admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:52.912867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a2360-1c6a-4ce0-a88e-27aff91a38dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:52.913147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a2360-1c6a-4ce0-a88e-27aff91a38dc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:52.928997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a2360-1c6a-4ce0-a88e-27aff91a38dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:24:52.931727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1d3bf-4d5b-4cec-b894-57f5de249128 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:52.935977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-a33a2360-1c6a-4ce0-a88e-27aff91a38dc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:24:52.937319 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 7/14] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:24:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:24:52.940492 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1d3bf-4d5b-4cec-b894-57f5de249128 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:52.942884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a2360-1c6a-4ce0-a88e-27aff91a38dc admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:52.944941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8fdf6-ef8f-48c1-be7c-23d800cab5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:52.945579 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8fdf6-ef8f-48c1-be7c-23d800cab5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:52.945865 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8fdf6-ef8f-48c1-be7c-23d800cab5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:52.946141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8fdf6-ef8f-48c1-be7c-23d800cab5f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:52.952037 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a2360-1c6a-4ce0-a88e-27aff91a38dc admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:52.954587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8fdf6-ef8f-48c1-be7c-23d800cab5f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:52.956365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8fdf6-ef8f-48c1-be7c-23d800cab5f5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:52.957156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1ee96-00c1-402b-aa13-fe4a050f206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:52.957789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1ee96-00c1-402b-aa13-fe4a050f206a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:52.958076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1ee96-00c1-402b-aa13-fe4a050f206a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:52.958389 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1ee96-00c1-402b-aa13-fe4a050f206a admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:52.959153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1ee96-00c1-402b-aa13-fe4a050f206a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:24:52.959462 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1ee96-00c1-402b-aa13-fe4a050f206a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:52.961239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-98d1ee96-00c1-402b-aa13-fe4a050f206a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:52.961239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:24:52.961239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:24:52.962135 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1ee96-00c1-402b-aa13-fe4a050f206a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:52.965054 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 8/15] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:24:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:24:52.971025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8fdf6-ef8f-48c1-be7c-23d800cab5f5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:52.977444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 8/16] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:24:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:24:52.979419 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8fdf6-ef8f-48c1-be7c-23d800cab5f5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:52.982691 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1ee96-00c1-402b-aa13-fe4a050f206a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:52.984129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d7488-b154-4895-9e1b-9e0665377145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:52.984889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d7488-b154-4895-9e1b-9e0665377145 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:52.985224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d7488-b154-4895-9e1b-9e0665377145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:52.985495 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d7488-b154-4895-9e1b-9e0665377145 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:52.986702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d7488-b154-4895-9e1b-9e0665377145 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:52.988456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d7488-b154-4895-9e1b-9e0665377145 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:52.990021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 9/17] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:52.992181 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1ee96-00c1-402b-aa13-fe4a050f206a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:52.996943 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aff9ca-dc28-4651-a54a-86e697095183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:52.997843 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aff9ca-dc28-4651-a54a-86e697095183 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:52.998127 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aff9ca-dc28-4651-a54a-86e697095183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:52.998452 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aff9ca-dc28-4651-a54a-86e697095183 admin admin] PATH_INFO: `/v3/users/100e11f767f7472887d51a9dc7231480` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:53.000575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aff9ca-dc28-4651-a54a-86e697095183 admin admin] RBAC: Authorizing `identity:get_user(user_id=100e11f767f7472887d51a9dc7231480)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:53.002898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aff9ca-dc28-4651-a54a-86e697095183 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:53.004747 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 9/18] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:24:52 2022] GET /identity/v3/users/100e11f767f7472887d51a9dc7231480 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:24:53.011328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d7488-b154-4895-9e1b-9e0665377145 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:53.022497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d7488-b154-4895-9e1b-9e0665377145 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:53.027019 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8756-084f-4065-b3c2-dc447cf0c5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:53.027847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8756-084f-4065-b3c2-dc447cf0c5bd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:53.028132 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8756-084f-4065-b3c2-dc447cf0c5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:53.028521 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8756-084f-4065-b3c2-dc447cf0c5bd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:53.029751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e8756-084f-4065-b3c2-dc447cf0c5bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:53.031596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e8756-084f-4065-b3c2-dc447cf0c5bd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:53.033856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 10/19] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:24:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:53.039893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aff9ca-dc28-4651-a54a-86e697095183 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:53.050064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aff9ca-dc28-4651-a54a-86e697095183 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:53.054824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59cce6-2954-4df1-9c6b-835312daf9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:53.055515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59cce6-2954-4df1-9c6b-835312daf9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:53.055810 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59cce6-2954-4df1-9c6b-835312daf9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:53.056089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59cce6-2954-4df1-9c6b-835312daf9e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:53.056953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59cce6-2954-4df1-9c6b-835312daf9e2 admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.domain.id=default, user.id=100e11f767f7472887d51a9dc7231480) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:24:53.057266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59cce6-2954-4df1-9c6b-835312daf9e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:53.058325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-3d59cce6-2954-4df1-9c6b-835312daf9e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:53.058325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:24:53.058325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:24:53.059516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59cce6-2954-4df1-9c6b-835312daf9e2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:53.069225 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 10/20] 10.222.0.79 () {56 vars in 1343 bytes} [Mon Feb 21 01:24:53 2022] GET /identity/v3/role_assignments?user.id=100e11f767f7472887d51a9dc7231480&scope.domain.id=default&role.id=548abad662724741a3261205ee7cb828 => generated 233 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:55.921648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716068c-b430-4286-a5cb-8e837cae744d None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:55.922734 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716068c-b430-4286-a5cb-8e837cae744d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:55.923225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716068c-b430-4286-a5cb-8e837cae744d None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:55.925979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 11/21] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:24:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:55.940204 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb954d15-af7c-49a4-a530-759039d1b2de None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:55.940723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb954d15-af7c-49a4-a530-759039d1b2de None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:55.940723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb954d15-af7c-49a4-a530-759039d1b2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:55.987820 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG passlib.handlers.bcrypt [None req-bb954d15-af7c-49a4-a530-759039d1b2de None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79371) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 21 01:24:55.988252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG passlib.handlers.bcrypt [None req-bb954d15-af7c-49a4-a530-759039d1b2de None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79371) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 21 01:24:56.046037 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-bb954d15-af7c-49a4-a530-759039d1b2de None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:56.047724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-bb954d15-af7c-49a4-a530-759039d1b2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:56.082258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 11/22] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:24:56.123669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716068c-b430-4286-a5cb-8e837cae744d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:56.140263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716068c-b430-4286-a5cb-8e837cae744d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:56.145347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740f411-6767-4c8a-936a-24a3f7974591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:56.146165 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740f411-6767-4c8a-936a-24a3f7974591 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.146626 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740f411-6767-4c8a-936a-24a3f7974591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.147032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740f411-6767-4c8a-936a-24a3f7974591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.147910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740f411-6767-4c8a-936a-24a3f7974591 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:56.149838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-0740f411-6767-4c8a-936a-24a3f7974591 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:56.149838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:24:56.149838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:24:56.155086 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740f411-6767-4c8a-936a-24a3f7974591 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:56.189263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec4559-4b52-4184-a98a-1dbcf1387164 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.189886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec4559-4b52-4184-a98a-1dbcf1387164 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.190408 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec4559-4b52-4184-a98a-1dbcf1387164 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.193146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 12/23] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:24:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:24:56.199120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251280f-6a89-4379-b727-43d1b53ec397 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.199657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251280f-6a89-4379-b727-43d1b53ec397 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.200138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251280f-6a89-4379-b727-43d1b53ec397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.239276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-8251280f-6a89-4379-b727-43d1b53ec397 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:56.240797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8251280f-6a89-4379-b727-43d1b53ec397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:56.263537 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 13/24] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:24:56.302030 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 12/25] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:24:56 2022] POST /identity/v3/roles => generated 219 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:24:56.307498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251280f-6a89-4379-b727-43d1b53ec397 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:56.322455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251280f-6a89-4379-b727-43d1b53ec397 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:56.334585 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af3eb-6a9d-41e9-86bf-d8ef4d2d0911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:56.335749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af3eb-6a9d-41e9-86bf-d8ef4d2d0911 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.336246 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af3eb-6a9d-41e9-86bf-d8ef4d2d0911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.336718 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af3eb-6a9d-41e9-86bf-d8ef4d2d0911 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.337802 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af3eb-6a9d-41e9-86bf-d8ef4d2d0911 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:56.339170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-300af3eb-6a9d-41e9-86bf-d8ef4d2d0911 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:56.339170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:24:56.339170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:24:56.340534 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af3eb-6a9d-41e9-86bf-d8ef4d2d0911 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:56.404641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3a5de-7f5f-467d-8241-8ed3ee303c9e None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.405287 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3a5de-7f5f-467d-8241-8ed3ee303c9e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.405771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3a5de-7f5f-467d-8241-8ed3ee303c9e None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.408168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 13/26] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:24:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:56.413644 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aa13c-a3c8-47ac-a236-6a662e2923ad None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.414309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aa13c-a3c8-47ac-a236-6a662e2923ad None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.414789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aa13c-a3c8-47ac-a236-6a662e2923ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.451153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b79aa13c-a3c8-47ac-a236-6a662e2923ad None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:56.453129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b79aa13c-a3c8-47ac-a236-6a662e2923ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:56.471032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 14/27] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:24:56.491260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 14/28] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:24:56 2022] POST /identity/v3/roles => generated 225 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:24:56.535984 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79aa13c-a3c8-47ac-a236-6a662e2923ad None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:56.551805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79aa13c-a3c8-47ac-a236-6a662e2923ad None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:56.561196 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb87c0-5719-4cb6-80c7-14c5c83964a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:56.562473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb87c0-5719-4cb6-80c7-14c5c83964a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.563061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb87c0-5719-4cb6-80c7-14c5c83964a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.564154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb87c0-5719-4cb6-80c7-14c5c83964a1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.587605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb87c0-5719-4cb6-80c7-14c5c83964a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:24:56.595143 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-aefb87c0-5719-4cb6-80c7-14c5c83964a1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:24:56.597051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 15/29] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:24:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:24:56.602998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af3eb-6a9d-41e9-86bf-d8ef4d2d0911 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:56.623344 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af3eb-6a9d-41e9-86bf-d8ef4d2d0911 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:56.633002 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f33ad-bb02-458e-9a5a-772e8885c95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:56.633956 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f33ad-bb02-458e-9a5a-772e8885c95b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.634060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f33ad-bb02-458e-9a5a-772e8885c95b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.634391 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f33ad-bb02-458e-9a5a-772e8885c95b admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.635176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f33ad-bb02-458e-9a5a-772e8885c95b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:24:56.635485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f33ad-bb02-458e-9a5a-772e8885c95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:56.637356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f33ad-bb02-458e-9a5a-772e8885c95b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:56.637531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86642a-ac68-43e4-ac81-f68ecf31b013 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.637961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86642a-ac68-43e4-ac81-f68ecf31b013 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.638415 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86642a-ac68-43e4-ac81-f68ecf31b013 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.640679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 16/30] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:24:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:56.647661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1e4b-8c6e-40c9-afba-81c823001672 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.648161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1e4b-8c6e-40c9-afba-81c823001672 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.648611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1e4b-8c6e-40c9-afba-81c823001672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.651443 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 15/31] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:24:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:56.657571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f33ad-bb02-458e-9a5a-772e8885c95b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:56.669018 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f33ad-bb02-458e-9a5a-772e8885c95b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:56.680090 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f1fa0-3132-44d5-898f-d8b6b16ee6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:56.681345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f1fa0-3132-44d5-898f-d8b6b16ee6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.681764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f1fa0-3132-44d5-898f-d8b6b16ee6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.682245 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f1fa0-3132-44d5-898f-d8b6b16ee6c1 admin admin] PATH_INFO: `/v3/users/100e11f767f7472887d51a9dc7231480` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.683196 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c42e1e4b-8c6e-40c9-afba-81c823001672 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:56.684939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c42e1e4b-8c6e-40c9-afba-81c823001672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:56.686031 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f1fa0-3132-44d5-898f-d8b6b16ee6c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=100e11f767f7472887d51a9dc7231480)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:56.689660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f1fa0-3132-44d5-898f-d8b6b16ee6c1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:56.692654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 16/32] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:24:56 2022] GET /identity/v3/users/100e11f767f7472887d51a9dc7231480 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:24:56.700304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f1fa0-3132-44d5-898f-d8b6b16ee6c1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:56.711013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 17/33] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:24:56.716160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f1fa0-3132-44d5-898f-d8b6b16ee6c1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:56.726601 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ce1a9-bc52-4412-844c-f9d938f18c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:56.727711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ce1a9-bc52-4412-844c-f9d938f18c3b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.728194 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ce1a9-bc52-4412-844c-f9d938f18c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.728616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ce1a9-bc52-4412-844c-f9d938f18c3b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.735909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ce1a9-bc52-4412-844c-f9d938f18c3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:56.737972 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ce1a9-bc52-4412-844c-f9d938f18c3b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:56.739992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 17/34] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:24:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:56.745775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1e4b-8c6e-40c9-afba-81c823001672 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:56.755190 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ce1a9-bc52-4412-844c-f9d938f18c3b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:56.761709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1e4b-8c6e-40c9-afba-81c823001672 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:56.770033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ce1a9-bc52-4412-844c-f9d938f18c3b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:56.776119 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a619a-ed03-4d48-97e3-7397d0e921ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:56.778045 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a619a-ed03-4d48-97e3-7397d0e921ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.778775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b33aa-e425-49d7-b3fa-58963cb43136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:56.779451 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a619a-ed03-4d48-97e3-7397d0e921ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.780250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b33aa-e425-49d7-b3fa-58963cb43136 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.780689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a619a-ed03-4d48-97e3-7397d0e921ec admin admin] PATH_INFO: `/v3/domains/default/users/100e11f767f7472887d51a9dc7231480/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.781540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b33aa-e425-49d7-b3fa-58963cb43136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.781812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b33aa-e425-49d7-b3fa-58963cb43136 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.784914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a619a-ed03-4d48-97e3-7397d0e921ec admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=100e11f767f7472887d51a9dc7231480, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:56.786191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-5e0a619a-ed03-4d48-97e3-7397d0e921ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:56.786191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:24:56.786191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:24:56.788491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a619a-ed03-4d48-97e3-7397d0e921ec admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:56.816393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b33aa-e425-49d7-b3fa-58963cb43136 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:56.818717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b33aa-e425-49d7-b3fa-58963cb43136 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:56.823806 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 18/35] 10.222.0.79 () {58 vars in 1382 bytes} [Mon Feb 21 01:24:56 2022] PUT /identity/v3/domains/default/users/100e11f767f7472887d51a9dc7231480/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:24:56.855731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-784b33aa-e425-49d7-b3fa-58963cb43136 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:24:56.867917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 18/36] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:24:56.874376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a619a-ed03-4d48-97e3-7397d0e921ec admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:56.962677 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a619a-ed03-4d48-97e3-7397d0e921ec admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:56.969274 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ea3a1-7113-4b16-8ee3-94d9fece0011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:56.970045 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ea3a1-7113-4b16-8ee3-94d9fece0011 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:56.970378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ea3a1-7113-4b16-8ee3-94d9fece0011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:56.970655 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ea3a1-7113-4b16-8ee3-94d9fece0011 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:56.971476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ea3a1-7113-4b16-8ee3-94d9fece0011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:24:56.971792 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ea3a1-7113-4b16-8ee3-94d9fece0011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:56.972840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-964ea3a1-7113-4b16-8ee3-94d9fece0011 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:56.972840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:24:56.972840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:24:56.973777 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ea3a1-7113-4b16-8ee3-94d9fece0011 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:56.999195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 19/37] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:57.005883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b33aa-e425-49d7-b3fa-58963cb43136 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:57.011386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bab8f6-5eba-433c-84d4-aeff3add75d4 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:57.011890 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bab8f6-5eba-433c-84d4-aeff3add75d4 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:57.012244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bab8f6-5eba-433c-84d4-aeff3add75d4 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:57.015354 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 20/38] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:24:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:57.019951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b33aa-e425-49d7-b3fa-58963cb43136 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:57.021436 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb36ec-f0ad-4734-a6f8-3fca48a25876 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:57.021732 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb36ec-f0ad-4734-a6f8-3fca48a25876 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:57.022012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb36ec-f0ad-4734-a6f8-3fca48a25876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:57.027345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47715b3b-96ed-4d64-9819-11195b184555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:57.027345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47715b3b-96ed-4d64-9819-11195b184555 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:57.027628 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47715b3b-96ed-4d64-9819-11195b184555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:57.027983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47715b3b-96ed-4d64-9819-11195b184555 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:57.028681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47715b3b-96ed-4d64-9819-11195b184555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:57.030485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-47715b3b-96ed-4d64-9819-11195b184555 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:57.030485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:24:57.030485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:24:57.031032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47715b3b-96ed-4d64-9819-11195b184555 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:57.043831 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-75bb36ec-f0ad-4734-a6f8-3fca48a25876 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:57.045022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-75bb36ec-f0ad-4734-a6f8-3fca48a25876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:57.054169 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 21/39] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:24:57.069155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 19/40] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:24:57 2022] POST /identity/v3/projects => generated 301 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:24:57.080283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb36ec-f0ad-4734-a6f8-3fca48a25876 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:57.090639 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb36ec-f0ad-4734-a6f8-3fca48a25876 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:57.153895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9dbdb-f2c9-49ba-989a-d2d60c16d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:57.154726 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9dbdb-f2c9-49ba-989a-d2d60c16d464 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:57.155065 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9dbdb-f2c9-49ba-989a-d2d60c16d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:57.155402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9dbdb-f2c9-49ba-989a-d2d60c16d464 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:57.156168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9dbdb-f2c9-49ba-989a-d2d60c16d464 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:57.158153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9dbdb-f2c9-49ba-989a-d2d60c16d464 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:57.177085 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 22/41] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:24:57 2022] POST /identity/v3/roles => generated 223 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:24:57.427494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7643696-6749-4667-8932-5018d51a48fa None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:57.427789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7643696-6749-4667-8932-5018d51a48fa None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:57.428063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7643696-6749-4667-8932-5018d51a48fa None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:57.429831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 20/42] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:57.435037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232c29e-8098-43ca-ae31-04fff89db081 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:57.435328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232c29e-8098-43ca-ae31-04fff89db081 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:57.435608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232c29e-8098-43ca-ae31-04fff89db081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:57.453462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-1232c29e-8098-43ca-ae31-04fff89db081 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:57.454689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1232c29e-8098-43ca-ae31-04fff89db081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:57.462286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 23/43] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:24:57.484683 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7643696-6749-4667-8932-5018d51a48fa None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:57.497042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7643696-6749-4667-8932-5018d51a48fa None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:57.502071 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e1839-ab86-4b18-83cb-9ab85be64979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:57.502871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e1839-ab86-4b18-83cb-9ab85be64979 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:57.503164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e1839-ab86-4b18-83cb-9ab85be64979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:57.503436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e1839-ab86-4b18-83cb-9ab85be64979 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:57.504626 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e1839-ab86-4b18-83cb-9ab85be64979 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:57.506363 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e1839-ab86-4b18-83cb-9ab85be64979 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:57.507915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 21/44] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:24:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:57.512929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232c29e-8098-43ca-ae31-04fff89db081 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:57.521584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232c29e-8098-43ca-ae31-04fff89db081 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:57.525847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd93d1d-d95b-4f13-8b2d-317f86fa836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:57.526525 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd93d1d-d95b-4f13-8b2d-317f86fa836e admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:57.526813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd93d1d-d95b-4f13-8b2d-317f86fa836e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:57.527096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd93d1d-d95b-4f13-8b2d-317f86fa836e admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:57.527805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd93d1d-d95b-4f13-8b2d-317f86fa836e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:57.528823 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-cfd93d1d-d95b-4f13-8b2d-317f86fa836e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:57.528823 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:24:57.528823 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:24:57.530149 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd93d1d-d95b-4f13-8b2d-317f86fa836e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:57.556812 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 24/45] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:24:57 2022] POST /identity/v3/projects => generated 312 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:24:59.184309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead31e-a309-4938-892b-d19149a6d7f6 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:59.184806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead31e-a309-4938-892b-d19149a6d7f6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:59.184886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead31e-a309-4938-892b-d19149a6d7f6 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:59.186681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 22/46] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:59.192531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c83e8-ab2f-46f1-bdc8-4157033e86f8 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:59.192906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c83e8-ab2f-46f1-bdc8-4157033e86f8 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:59.193104 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c83e8-ab2f-46f1-bdc8-4157033e86f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:59.211285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a45c83e8-ab2f-46f1-bdc8-4157033e86f8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:59.212463 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a45c83e8-ab2f-46f1-bdc8-4157033e86f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:59.267709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 25/47] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:24:59.291248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fead31e-a309-4938-892b-d19149a6d7f6 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:59.303914 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fead31e-a309-4938-892b-d19149a6d7f6 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:59.308142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53a2ac-9b97-416d-9eb2-4b65eb37356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:59.308929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53a2ac-9b97-416d-9eb2-4b65eb37356c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:59.309214 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53a2ac-9b97-416d-9eb2-4b65eb37356c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:59.309490 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53a2ac-9b97-416d-9eb2-4b65eb37356c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:59.320055 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53a2ac-9b97-416d-9eb2-4b65eb37356c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:24:59.326927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-3e53a2ac-9b97-416d-9eb2-4b65eb37356c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:24:59.328100 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 23/48] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:24:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:24:59.334345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c83e8-ab2f-46f1-bdc8-4157033e86f8 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:59.343198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c83e8-ab2f-46f1-bdc8-4157033e86f8 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:59.347598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb80000-7d60-46fc-9347-37e93a6ccc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:59.348250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb80000-7d60-46fc-9347-37e93a6ccc3d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:59.348537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb80000-7d60-46fc-9347-37e93a6ccc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:59.348814 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb80000-7d60-46fc-9347-37e93a6ccc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:59.349572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb80000-7d60-46fc-9347-37e93a6ccc3d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:24:59.349882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb80000-7d60-46fc-9347-37e93a6ccc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:59.350952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-0bb80000-7d60-46fc-9347-37e93a6ccc3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:59.350952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:24:59.350952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:24:59.351867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb80000-7d60-46fc-9347-37e93a6ccc3d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:59.364717 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 26/49] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:24:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:59.370089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53a2ac-9b97-416d-9eb2-4b65eb37356c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:59.381098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53a2ac-9b97-416d-9eb2-4b65eb37356c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:59.385443 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a9ab1-a6dc-4987-8240-70ca67a588ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:59.386333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a9ab1-a6dc-4987-8240-70ca67a588ff admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:59.386622 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a9ab1-a6dc-4987-8240-70ca67a588ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:59.386901 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a9ab1-a6dc-4987-8240-70ca67a588ff admin admin] PATH_INFO: `/v3/users/100e11f767f7472887d51a9dc7231480` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:59.388098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a9ab1-a6dc-4987-8240-70ca67a588ff admin admin] RBAC: Authorizing `identity:get_user(user_id=100e11f767f7472887d51a9dc7231480)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:59.389933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a9ab1-a6dc-4987-8240-70ca67a588ff admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:59.392273 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 24/50] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:24:59 2022] GET /identity/v3/users/100e11f767f7472887d51a9dc7231480 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:59.397219 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb80000-7d60-46fc-9347-37e93a6ccc3d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:59.406805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb80000-7d60-46fc-9347-37e93a6ccc3d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:59.411146 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261c84b-974c-4793-b3df-6f92299f7cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:59.411928 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c84b-974c-4793-b3df-6f92299f7cca admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:59.412217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c84b-974c-4793-b3df-6f92299f7cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:59.412498 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c84b-974c-4793-b3df-6f92299f7cca admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:59.413685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261c84b-974c-4793-b3df-6f92299f7cca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:59.415429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261c84b-974c-4793-b3df-6f92299f7cca admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:59.417179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 27/51] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:24:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:59.422367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a9ab1-a6dc-4987-8240-70ca67a588ff admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:59.431982 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a9ab1-a6dc-4987-8240-70ca67a588ff admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:59.436317 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133966b7-4c7e-4850-b37e-ed62bc2b80d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:59.436958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133966b7-4c7e-4850-b37e-ed62bc2b80d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:59.437250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133966b7-4c7e-4850-b37e-ed62bc2b80d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:59.437531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133966b7-4c7e-4850-b37e-ed62bc2b80d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:59.438933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133966b7-4c7e-4850-b37e-ed62bc2b80d1 admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.domain.id=default, user.id=100e11f767f7472887d51a9dc7231480) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:24:59.439248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133966b7-4c7e-4850-b37e-ed62bc2b80d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:59.441119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133966b7-4c7e-4850-b37e-ed62bc2b80d1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:59.448350 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 25/52] 10.222.0.79 () {56 vars in 1343 bytes} [Mon Feb 21 01:24:59 2022] GET /identity/v3/role_assignments?user.id=100e11f767f7472887d51a9dc7231480&scope.domain.id=default&role.id=548abad662724741a3261205ee7cb828 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:24:59.887838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b1894-c92d-4e3c-b0db-d16bfb28d924 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:59.888124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b1894-c92d-4e3c-b0db-d16bfb28d924 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:59.888398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b1894-c92d-4e3c-b0db-d16bfb28d924 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:59.890165 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 28/53] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:59.895427 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbe257-da91-42c4-9380-df1ca424849e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:59.895716 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbe257-da91-42c4-9380-df1ca424849e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:59.895992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbe257-da91-42c4-9380-df1ca424849e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:59.913907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-1adbe257-da91-42c4-9380-df1ca424849e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:59.915415 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-1adbe257-da91-42c4-9380-df1ca424849e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:59.923420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 26/54] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:24:59.946269 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b1894-c92d-4e3c-b0db-d16bfb28d924 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:59.957966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b1894-c92d-4e3c-b0db-d16bfb28d924 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:59.962333 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e94e0-c56b-441e-b7cb-0a20af874f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:59.963103 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e94e0-c56b-441e-b7cb-0a20af874f58 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:59.963387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e94e0-c56b-441e-b7cb-0a20af874f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:59.963660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e94e0-c56b-441e-b7cb-0a20af874f58 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:59.964806 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e94e0-c56b-441e-b7cb-0a20af874f58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:59.966540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e94e0-c56b-441e-b7cb-0a20af874f58 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:59.968097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 29/55] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:24:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:24:59.973663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbe257-da91-42c4-9380-df1ca424849e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:59.982457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbe257-da91-42c4-9380-df1ca424849e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:59.987327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed031d-f391-4ce2-9bcf-203f5af1d354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:59.987968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed031d-f391-4ce2-9bcf-203f5af1d354 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:59.988255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed031d-f391-4ce2-9bcf-203f5af1d354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:59.988535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed031d-f391-4ce2-9bcf-203f5af1d354 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:59.989249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed031d-f391-4ce2-9bcf-203f5af1d354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:59.991206 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed031d-f391-4ce2-9bcf-203f5af1d354 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:00.014820 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 27/56] 10.222.0.79 () {60 vars in 1161 bytes} [Mon Feb 21 01:24:59 2022] POST /identity/v3/projects => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:02.281401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a6b3b-c0db-40ef-a7ef-9eab1a647160 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:02.282461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a6b3b-c0db-40ef-a7ef-9eab1a647160 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:02.282546 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a6b3b-c0db-40ef-a7ef-9eab1a647160 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:02.284272 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 30/57] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:02.289379 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df690f2-fa82-4aab-9b99-a960c4ac5d57 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:02.289787 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df690f2-fa82-4aab-9b99-a960c4ac5d57 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:02.289947 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df690f2-fa82-4aab-9b99-a960c4ac5d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:02.307957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2df690f2-fa82-4aab-9b99-a960c4ac5d57 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:02.309137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2df690f2-fa82-4aab-9b99-a960c4ac5d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:02.372242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 28/58] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:02.396379 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a6b3b-c0db-40ef-a7ef-9eab1a647160 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:02.408425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a6b3b-c0db-40ef-a7ef-9eab1a647160 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:02.412563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c4cd5-1c9d-4e14-9f9d-eaf1146e5f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:02.413326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c4cd5-1c9d-4e14-9f9d-eaf1146e5f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:02.413608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c4cd5-1c9d-4e14-9f9d-eaf1146e5f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:02.413878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c4cd5-1c9d-4e14-9f9d-eaf1146e5f98 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:02.415064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c4cd5-1c9d-4e14-9f9d-eaf1146e5f98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:02.416750 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c4cd5-1c9d-4e14-9f9d-eaf1146e5f98 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:02.418316 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 31/59] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:02.423884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df690f2-fa82-4aab-9b99-a960c4ac5d57 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:02.432581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df690f2-fa82-4aab-9b99-a960c4ac5d57 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:02.437271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e07fc2-e2b2-4e51-b5d6-70c07c238b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:02.437947 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e07fc2-e2b2-4e51-b5d6-70c07c238b25 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:02.438275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e07fc2-e2b2-4e51-b5d6-70c07c238b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:02.438564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e07fc2-e2b2-4e51-b5d6-70c07c238b25 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:02.439288 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e07fc2-e2b2-4e51-b5d6-70c07c238b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:02.440307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-76e07fc2-e2b2-4e51-b5d6-70c07c238b25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:02.440307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:25:02.440307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:25:02.441638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e07fc2-e2b2-4e51-b5d6-70c07c238b25 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:02.466609 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 29/60] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:25:02 2022] POST /identity/v3/users => generated 275 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:25:05.997715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddca3-2be4-40de-b00d-86af76d3cdde None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:05.998275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddca3-2be4-40de-b00d-86af76d3cdde None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:05.998275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddca3-2be4-40de-b00d-86af76d3cdde None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.000391 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 32/61] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:06.015913 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf8bc-7f74-497d-84fe-890ffced346d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.016775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf8bc-7f74-497d-84fe-890ffced346d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.017224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf8bc-7f74-497d-84fe-890ffced346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.043222 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-ac9cf8bc-7f74-497d-84fe-890ffced346d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:06.044660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ac9cf8bc-7f74-497d-84fe-890ffced346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:06.054127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca4517-2673-4316-a2a2-9f66b576431e None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.054127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca4517-2673-4316-a2a2-9f66b576431e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.054127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca4517-2673-4316-a2a2-9f66b576431e None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.056288 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 33/62] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:06.057597 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 30/63] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:06.061767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cbdb2-ec7b-43d5-9df0-011e7320d324 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.062238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cbdb2-ec7b-43d5-9df0-011e7320d324 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.062664 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cbdb2-ec7b-43d5-9df0-011e7320d324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.082350 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cf8bc-7f74-497d-84fe-890ffced346d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.092715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cf8bc-7f74-497d-84fe-890ffced346d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.099274 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-4e2cbdb2-ec7b-43d5-9df0-011e7320d324 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:06.101043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-4e2cbdb2-ec7b-43d5-9df0-011e7320d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:06.106444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863c0e5-de39-4bf8-bbf4-769440507d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.107529 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863c0e5-de39-4bf8-bbf4-769440507d40 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.108599 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863c0e5-de39-4bf8-bbf4-769440507d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.109035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863c0e5-de39-4bf8-bbf4-769440507d40 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.120286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 34/64] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:06.139349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863c0e5-de39-4bf8-bbf4-769440507d40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:06.151155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-6863c0e5-de39-4bf8-bbf4-769440507d40 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:06.152726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 31/65] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:06.158563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cbdb2-ec7b-43d5-9df0-011e7320d324 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.165875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863c0e5-de39-4bf8-bbf4-769440507d40 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.171205 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cbdb2-ec7b-43d5-9df0-011e7320d324 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.175822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a2d61-c2d9-40bd-810c-55d014c4da0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.176648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a2d61-c2d9-40bd-810c-55d014c4da0e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.177073 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a2d61-c2d9-40bd-810c-55d014c4da0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.177486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a2d61-c2d9-40bd-810c-55d014c4da0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.178416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a2d61-c2d9-40bd-810c-55d014c4da0e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:06.178858 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a2d61-c2d9-40bd-810c-55d014c4da0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.180613 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a2d61-c2d9-40bd-810c-55d014c4da0e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.185089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863c0e5-de39-4bf8-bbf4-769440507d40 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.196114 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 35/66] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.196618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f89f44-a995-44ae-91c4-08dd7c000e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.197629 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f89f44-a995-44ae-91c4-08dd7c000e3e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.197956 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71742eb6-5808-4bf9-b475-507566a53e59 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.198065 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f89f44-a995-44ae-91c4-08dd7c000e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.198460 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f89f44-a995-44ae-91c4-08dd7c000e3e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.198684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71742eb6-5808-4bf9-b475-507566a53e59 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.199176 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71742eb6-5808-4bf9-b475-507566a53e59 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.201385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 36/67] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:06.202361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71742eb6-5808-4bf9-b475-507566a53e59 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.218158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f89f44-a995-44ae-91c4-08dd7c000e3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:06.223963 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71742eb6-5808-4bf9-b475-507566a53e59 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.226259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-95f89f44-a995-44ae-91c4-08dd7c000e3e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:25:06.227785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 32/68] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:06.229401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d782-05bd-4aa0-9152-d01d6eeafda8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.229690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d782-05bd-4aa0-9152-d01d6eeafda8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.229882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bfa03-f190-4072-9f25-a727850cc420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.229992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d782-05bd-4aa0-9152-d01d6eeafda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.231349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bfa03-f190-4072-9f25-a727850cc420 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.231833 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bfa03-f190-4072-9f25-a727850cc420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.232308 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bfa03-f190-4072-9f25-a727850cc420 admin admin] PATH_INFO: `/v3/users/afb1e9b4dc2b4c36880beab449c95d29` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.248328 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-7782d782-05bd-4aa0-9152-d01d6eeafda8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:06.249418 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-7782d782-05bd-4aa0-9152-d01d6eeafda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:06.254797 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bfa03-f190-4072-9f25-a727850cc420 admin admin] RBAC: Authorizing `identity:get_user(user_id=afb1e9b4dc2b4c36880beab449c95d29)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.257231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bfa03-f190-4072-9f25-a727850cc420 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.259504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 37/69] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/users/afb1e9b4dc2b4c36880beab449c95d29 => generated 275 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.260489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bfa03-f190-4072-9f25-a727850cc420 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.262284 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 33/70] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:06.264687 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782d782-05bd-4aa0-9152-d01d6eeafda8 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.280785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782d782-05bd-4aa0-9152-d01d6eeafda8 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.283591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bfa03-f190-4072-9f25-a727850cc420 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.290761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07657f6f-caf0-494b-9bb1-0edd1a8d6ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.291930 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07657f6f-caf0-494b-9bb1-0edd1a8d6ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.292874 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07657f6f-caf0-494b-9bb1-0edd1a8d6ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.293581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a2616-ec2c-4e77-b806-5909ba1f70a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.294475 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a2616-ec2c-4e77-b806-5909ba1f70a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.294594 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07657f6f-caf0-494b-9bb1-0edd1a8d6ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.295077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a2616-ec2c-4e77-b806-5909ba1f70a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.295388 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07657f6f-caf0-494b-9bb1-0edd1a8d6ef3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:06.295705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07657f6f-caf0-494b-9bb1-0edd1a8d6ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.295932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a2616-ec2c-4e77-b806-5909ba1f70a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.297549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07657f6f-caf0-494b-9bb1-0edd1a8d6ef3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.304713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a2616-ec2c-4e77-b806-5909ba1f70a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.306633 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 38/71] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.306998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a2616-ec2c-4e77-b806-5909ba1f70a4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.307558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07657f6f-caf0-494b-9bb1-0edd1a8d6ef3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.317154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07657f6f-caf0-494b-9bb1-0edd1a8d6ef3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.317459 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 34/72] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:06.318517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a2616-ec2c-4e77-b806-5909ba1f70a4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.322119 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106e444-b185-41ef-bab8-10a454872a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.322944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106e444-b185-41ef-bab8-10a454872a63 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.323226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106e444-b185-41ef-bab8-10a454872a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.323504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106e444-b185-41ef-bab8-10a454872a63 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.329099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a2616-ec2c-4e77-b806-5909ba1f70a4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.334028 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6607d67-47c4-4359-89eb-cf7f8447003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.335182 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6607d67-47c4-4359-89eb-cf7f8447003a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.335355 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106e444-b185-41ef-bab8-10a454872a63 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:06.335821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6607d67-47c4-4359-89eb-cf7f8447003a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.336290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6607d67-47c4-4359-89eb-cf7f8447003a admin admin] PATH_INFO: `/v3/users/100e11f767f7472887d51a9dc7231480` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.337685 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6607d67-47c4-4359-89eb-cf7f8447003a admin admin] RBAC: Authorizing `identity:get_user(user_id=100e11f767f7472887d51a9dc7231480)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.339745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6607d67-47c4-4359-89eb-cf7f8447003a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.341540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 35/73] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/users/100e11f767f7472887d51a9dc7231480 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.342494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6607d67-47c4-4359-89eb-cf7f8447003a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.342971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-9106e444-b185-41ef-bab8-10a454872a63 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:06.349625 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 39/74] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:06.350514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106e444-b185-41ef-bab8-10a454872a63 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.353383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6607d67-47c4-4359-89eb-cf7f8447003a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.358285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cd3e4-64f5-4a11-8d4e-ea435cbf4399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.359340 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cd3e4-64f5-4a11-8d4e-ea435cbf4399 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.360395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cd3e4-64f5-4a11-8d4e-ea435cbf4399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.360883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cd3e4-64f5-4a11-8d4e-ea435cbf4399 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.362312 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106e444-b185-41ef-bab8-10a454872a63 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.362420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838cd3e4-64f5-4a11-8d4e-ea435cbf4399 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.364688 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838cd3e4-64f5-4a11-8d4e-ea435cbf4399 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.366590 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 36/75] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.367032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77339e04-153e-4070-a5b0-9576197477e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.367790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77339e04-153e-4070-a5b0-9576197477e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.368054 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cd3e4-64f5-4a11-8d4e-ea435cbf4399 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.368165 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77339e04-153e-4070-a5b0-9576197477e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.368351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77339e04-153e-4070-a5b0-9576197477e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.377861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77339e04-153e-4070-a5b0-9576197477e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.379432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cd3e4-64f5-4a11-8d4e-ea435cbf4399 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.379691 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77339e04-153e-4070-a5b0-9576197477e7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.384313 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b6ec1-d298-4b39-8bd4-42b32468cf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.385187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b6ec1-d298-4b39-8bd4-42b32468cf67 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.385685 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b6ec1-d298-4b39-8bd4-42b32468cf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.386155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b6ec1-d298-4b39-8bd4-42b32468cf67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.387454 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b6ec1-d298-4b39-8bd4-42b32468cf67 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:06.387978 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b6ec1-d298-4b39-8bd4-42b32468cf67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.389750 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b6ec1-d298-4b39-8bd4-42b32468cf67 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.389881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 40/76] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:06.390666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77339e04-153e-4070-a5b0-9576197477e7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.399074 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 37/77] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.404154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77339e04-153e-4070-a5b0-9576197477e7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.404650 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b6ec1-d298-4b39-8bd4-42b32468cf67 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.405369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f94eb-aee5-4beb-aa01-76248ef43f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.406160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f94eb-aee5-4beb-aa01-76248ef43f54 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.406471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f94eb-aee5-4beb-aa01-76248ef43f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.406832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f94eb-aee5-4beb-aa01-76248ef43f54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.407677 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f94eb-aee5-4beb-aa01-76248ef43f54 admin admin] RBAC: Adding query filter params (role.id=3d85c07c87374b898492488d6e608a27, scope.project.id=3c4f1a5a685848d5bd703ae910481be2, user.id=afb1e9b4dc2b4c36880beab449c95d29) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:06.407995 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f94eb-aee5-4beb-aa01-76248ef43f54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.409010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-383f94eb-aee5-4beb-aa01-76248ef43f54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:06.409010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:25:06.409010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:25:06.410161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f94eb-aee5-4beb-aa01-76248ef43f54 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.416397 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b6ec1-d298-4b39-8bd4-42b32468cf67 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.417647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 41/78] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/role_assignments?user.id=afb1e9b4dc2b4c36880beab449c95d29&scope.project.id=3c4f1a5a685848d5bd703ae910481be2&role.id=3d85c07c87374b898492488d6e608a27 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.418333 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f94eb-aee5-4beb-aa01-76248ef43f54 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.433829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df134690-dfdb-49e5-8449-11c0d75579c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.435142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df134690-dfdb-49e5-8449-11c0d75579c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.435670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df134690-dfdb-49e5-8449-11c0d75579c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.436153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df134690-dfdb-49e5-8449-11c0d75579c7 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.440691 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df134690-dfdb-49e5-8449-11c0d75579c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.443233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df134690-dfdb-49e5-8449-11c0d75579c7 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.446059 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f94eb-aee5-4beb-aa01-76248ef43f54 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.448336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 38/79] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.454316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df134690-dfdb-49e5-8449-11c0d75579c7 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.454979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0c420-f89c-4a8a-9f3f-4a30f4d60260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.456591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0c420-f89c-4a8a-9f3f-4a30f4d60260 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.461544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0c420-f89c-4a8a-9f3f-4a30f4d60260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.462160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0c420-f89c-4a8a-9f3f-4a30f4d60260 admin admin] PATH_INFO: `/v3/users/afb1e9b4dc2b4c36880beab449c95d29` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.466734 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0c420-f89c-4a8a-9f3f-4a30f4d60260 admin admin] RBAC: Authorizing `identity:get_user(user_id=afb1e9b4dc2b4c36880beab449c95d29)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.469318 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0c420-f89c-4a8a-9f3f-4a30f4d60260 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.472163 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df134690-dfdb-49e5-8449-11c0d75579c7 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.474257 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 42/80] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/users/afb1e9b4dc2b4c36880beab449c95d29 => generated 275 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.480974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0c420-f89c-4a8a-9f3f-4a30f4d60260 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.489061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142bb54-3b35-487e-a6d5-7b5a4baf6011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.490154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142bb54-3b35-487e-a6d5-7b5a4baf6011 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.490154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142bb54-3b35-487e-a6d5-7b5a4baf6011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.490374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142bb54-3b35-487e-a6d5-7b5a4baf6011 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.491210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142bb54-3b35-487e-a6d5-7b5a4baf6011 admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=3c4f1a5a685848d5bd703ae910481be2, user.id=100e11f767f7472887d51a9dc7231480) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:06.491532 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142bb54-3b35-487e-a6d5-7b5a4baf6011 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.493515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142bb54-3b35-487e-a6d5-7b5a4baf6011 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.495111 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0c420-f89c-4a8a-9f3f-4a30f4d60260 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.506312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 39/81] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/role_assignments?user.id=100e11f767f7472887d51a9dc7231480&scope.project.id=3c4f1a5a685848d5bd703ae910481be2&role.id=548abad662724741a3261205ee7cb828 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:06.506312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffabfd8-f34c-4b55-8c5e-24437a17ea8e None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.506312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffabfd8-f34c-4b55-8c5e-24437a17ea8e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.506312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffabfd8-f34c-4b55-8c5e-24437a17ea8e None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.506312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 40/82] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:06.507681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee021bf-283a-4bb5-9944-21560ca91865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.508597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee021bf-283a-4bb5-9944-21560ca91865 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.509101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee021bf-283a-4bb5-9944-21560ca91865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.509580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee021bf-283a-4bb5-9944-21560ca91865 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.511748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792692e-75c8-4096-82a2-e3b54e7585e3 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.512040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792692e-75c8-4096-82a2-e3b54e7585e3 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.512328 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792692e-75c8-4096-82a2-e3b54e7585e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.528260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee021bf-283a-4bb5-9944-21560ca91865 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.530494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee021bf-283a-4bb5-9944-21560ca91865 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.531138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-8792692e-75c8-4096-82a2-e3b54e7585e3 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:06.532388 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8792692e-75c8-4096-82a2-e3b54e7585e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:06.540490 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 41/83] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:06.547873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 43/84] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:06.549761 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37371a25-8a87-44e6-b23b-df86b43d14f9 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.550382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37371a25-8a87-44e6-b23b-df86b43d14f9 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.550908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37371a25-8a87-44e6-b23b-df86b43d14f9 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.552985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 42/85] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:06.554181 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee021bf-283a-4bb5-9944-21560ca91865 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.560347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6751d9-cb99-443d-866f-ef54acd43fce None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.560976 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6751d9-cb99-443d-866f-ef54acd43fce None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.561461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6751d9-cb99-443d-866f-ef54acd43fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.569405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee021bf-283a-4bb5-9944-21560ca91865 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.575965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9550825-0a62-4070-9e61-c8907dff79f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.577239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9550825-0a62-4070-9e61-c8907dff79f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.577735 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9550825-0a62-4070-9e61-c8907dff79f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.578263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9550825-0a62-4070-9e61-c8907dff79f2 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.580665 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9550825-0a62-4070-9e61-c8907dff79f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.583527 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9550825-0a62-4070-9e61-c8907dff79f2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.585483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-df6751d9-cb99-443d-866f-ef54acd43fce None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:06.585862 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 44/86] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.586907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9550825-0a62-4070-9e61-c8907dff79f2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.587040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-df6751d9-cb99-443d-866f-ef54acd43fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:06.596198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 43/87] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:06.597250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6751d9-cb99-443d-866f-ef54acd43fce None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.598747 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9550825-0a62-4070-9e61-c8907dff79f2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.603911 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21399e-00c5-4c3b-9536-33ea325f815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.605638 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21399e-00c5-4c3b-9536-33ea325f815c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.606429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21399e-00c5-4c3b-9536-33ea325f815c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.606940 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21399e-00c5-4c3b-9536-33ea325f815c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.608624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6751d9-cb99-443d-866f-ef54acd43fce None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.613876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831870d-ce2b-426d-944d-c9b75c9accce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.614583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831870d-ce2b-426d-944d-c9b75c9accce admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.614922 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831870d-ce2b-426d-944d-c9b75c9accce admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.615203 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831870d-ce2b-426d-944d-c9b75c9accce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.616304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831870d-ce2b-426d-944d-c9b75c9accce admin admin] RBAC: Adding query filter params (role.id=289d1250826d4384990c8f3d403bc047, scope.project.id=3c4f1a5a685848d5bd703ae910481be2, user.id=afb1e9b4dc2b4c36880beab449c95d29) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:06.616626 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831870d-ce2b-426d-944d-c9b75c9accce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.618949 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831870d-ce2b-426d-944d-c9b75c9accce admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.623602 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21399e-00c5-4c3b-9536-33ea325f815c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:06.625380 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 44/88] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/role_assignments?user.id=afb1e9b4dc2b4c36880beab449c95d29&scope.project.id=3c4f1a5a685848d5bd703ae910481be2&role.id=289d1250826d4384990c8f3d403bc047 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.631478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831870d-ce2b-426d-944d-c9b75c9accce admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.632866 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-bd21399e-00c5-4c3b-9536-33ea325f815c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:06.634656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 45/89] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:06.650242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21399e-00c5-4c3b-9536-33ea325f815c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.650442 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831870d-ce2b-426d-944d-c9b75c9accce admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.654656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffbfd7-9d0a-4a8f-8be4-967b16fe7fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.655676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffbfd7-9d0a-4a8f-8be4-967b16fe7fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.655783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffbfd7-9d0a-4a8f-8be4-967b16fe7fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.656039 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffbfd7-9d0a-4a8f-8be4-967b16fe7fa8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.657961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffbfd7-9d0a-4a8f-8be4-967b16fe7fa8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.659737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffbfd7-9d0a-4a8f-8be4-967b16fe7fa8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.661515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 45/90] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.661975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21399e-00c5-4c3b-9536-33ea325f815c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.667545 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffbfd7-9d0a-4a8f-8be4-967b16fe7fa8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.678422 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41074a87-3777-49a0-bf77-82a266608593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.679134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41074a87-3777-49a0-bf77-82a266608593 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.679425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41074a87-3777-49a0-bf77-82a266608593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.681171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41074a87-3777-49a0-bf77-82a266608593 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.683203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41074a87-3777-49a0-bf77-82a266608593 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:06.683530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41074a87-3777-49a0-bf77-82a266608593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.686665 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41074a87-3777-49a0-bf77-82a266608593 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.690659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffbfd7-9d0a-4a8f-8be4-967b16fe7fa8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.699959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d0a25-4d7a-4aba-ae4c-d44f105aaba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.700672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d0a25-4d7a-4aba-ae4c-d44f105aaba5 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.700961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d0a25-4d7a-4aba-ae4c-d44f105aaba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.702672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d0a25-4d7a-4aba-ae4c-d44f105aaba5 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.703785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d0a25-4d7a-4aba-ae4c-d44f105aaba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.705879 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d0a25-4d7a-4aba-ae4c-d44f105aaba5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.708342 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 46/91] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.713858 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41074a87-3777-49a0-bf77-82a266608593 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.730149 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41074a87-3777-49a0-bf77-82a266608593 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.736505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f5a7f-0d7c-4543-b1aa-8c4fb2711aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.737431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f5a7f-0d7c-4543-b1aa-8c4fb2711aea admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.737713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f5a7f-0d7c-4543-b1aa-8c4fb2711aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.737982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f5a7f-0d7c-4543-b1aa-8c4fb2711aea admin admin] PATH_INFO: `/v3/users/afb1e9b4dc2b4c36880beab449c95d29` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.739431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f5a7f-0d7c-4543-b1aa-8c4fb2711aea admin admin] RBAC: Authorizing `identity:get_user(user_id=afb1e9b4dc2b4c36880beab449c95d29)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.741807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f5a7f-0d7c-4543-b1aa-8c4fb2711aea admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.743725 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 47/92] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/users/afb1e9b4dc2b4c36880beab449c95d29 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:06.756228 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 46/93] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:25:06 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:06.756820 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f5a7f-0d7c-4543-b1aa-8c4fb2711aea admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.778990 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f5a7f-0d7c-4543-b1aa-8c4fb2711aea admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.786939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c235c-cecc-4521-9228-99361c9360cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.788070 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c235c-cecc-4521-9228-99361c9360cd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.788603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c235c-cecc-4521-9228-99361c9360cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.789096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c235c-cecc-4521-9228-99361c9360cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.800822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c235c-cecc-4521-9228-99361c9360cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.803253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c235c-cecc-4521-9228-99361c9360cd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.814651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 48/94] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:06.820590 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d0a25-4d7a-4aba-ae4c-d44f105aaba5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.843021 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d0a25-4d7a-4aba-ae4c-d44f105aaba5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.851131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace07c7-7ca2-487e-96df-f8641a8b1b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.852028 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace07c7-7ca2-487e-96df-f8641a8b1b60 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.852316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace07c7-7ca2-487e-96df-f8641a8b1b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.852596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace07c7-7ca2-487e-96df-f8641a8b1b60 admin admin] PATH_INFO: `/v3/projects/df582b65bcd84f9e8ab8765906d76f48` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.853907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace07c7-7ca2-487e-96df-f8641a8b1b60 admin admin] RBAC: Authorizing `identity:get_project(project_id=df582b65bcd84f9e8ab8765906d76f48)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.856094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace07c7-7ca2-487e-96df-f8641a8b1b60 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.858111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 47/95] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/projects/df582b65bcd84f9e8ab8765906d76f48 => generated 312 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:06.864091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c235c-cecc-4521-9228-99361c9360cd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.878597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c235c-cecc-4521-9228-99361c9360cd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.884960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05bad5-3d35-490e-9e9d-3f42b7dc1301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.885643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05bad5-3d35-490e-9e9d-3f42b7dc1301 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.885936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05bad5-3d35-490e-9e9d-3f42b7dc1301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.886251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05bad5-3d35-490e-9e9d-3f42b7dc1301 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.887286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05bad5-3d35-490e-9e9d-3f42b7dc1301 admin admin] RBAC: Adding query filter params (role.id=3d85c07c87374b898492488d6e608a27, scope.project.id=df582b65bcd84f9e8ab8765906d76f48, user.id=afb1e9b4dc2b4c36880beab449c95d29) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:06.887604 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05bad5-3d35-490e-9e9d-3f42b7dc1301 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.889566 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05bad5-3d35-490e-9e9d-3f42b7dc1301 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.896994 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 49/96] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/role_assignments?user.id=afb1e9b4dc2b4c36880beab449c95d29&scope.project.id=df582b65bcd84f9e8ab8765906d76f48&role.id=3d85c07c87374b898492488d6e608a27 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:09.384838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9a35c-2db7-4bb6-b698-d36bc245cefa None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:09.385905 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9a35c-2db7-4bb6-b698-d36bc245cefa None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:09.386414 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9a35c-2db7-4bb6-b698-d36bc245cefa None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:09.388395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 48/97] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:09.394402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c2d1c-b064-40f3-9204-0d53957f9244 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:09.395223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c2d1c-b064-40f3-9204-0d53957f9244 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:09.395722 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c2d1c-b064-40f3-9204-0d53957f9244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:09.420193 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-935c2d1c-b064-40f3-9204-0d53957f9244 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:09.421700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-935c2d1c-b064-40f3-9204-0d53957f9244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:09.435513 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 50/98] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:09.471264 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9a35c-2db7-4bb6-b698-d36bc245cefa None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:09.488149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9a35c-2db7-4bb6-b698-d36bc245cefa None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:09.492882 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e1997-4435-42b9-a28a-769f230c8c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:09.493895 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e1997-4435-42b9-a28a-769f230c8c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:09.494404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e1997-4435-42b9-a28a-769f230c8c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:09.494881 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e1997-4435-42b9-a28a-769f230c8c49 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:09.511003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e1997-4435-42b9-a28a-769f230c8c49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:09.518760 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-ea8e1997-4435-42b9-a28a-769f230c8c49 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:09.520141 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 49/99] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:09.525829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c2d1c-b064-40f3-9204-0d53957f9244 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:09.536019 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c2d1c-b064-40f3-9204-0d53957f9244 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:09.545731 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f55e5-7bf9-4c53-bb67-abcbfd09107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:09.546667 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f55e5-7bf9-4c53-bb67-abcbfd09107f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:09.547182 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f55e5-7bf9-4c53-bb67-abcbfd09107f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:09.547657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f55e5-7bf9-4c53-bb67-abcbfd09107f admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:09.548642 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f55e5-7bf9-4c53-bb67-abcbfd09107f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:09.549159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f55e5-7bf9-4c53-bb67-abcbfd09107f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:09.551026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f55e5-7bf9-4c53-bb67-abcbfd09107f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:09.560134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 51/100] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:09.565804 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e1997-4435-42b9-a28a-769f230c8c49 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:09.577070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e1997-4435-42b9-a28a-769f230c8c49 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:09.586806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fe370-e4fc-4392-953c-fb57b01c7e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:09.588016 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fe370-e4fc-4392-953c-fb57b01c7e2e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:09.588506 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fe370-e4fc-4392-953c-fb57b01c7e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:09.588960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fe370-e4fc-4392-953c-fb57b01c7e2e admin admin] PATH_INFO: `/v3/users/afb1e9b4dc2b4c36880beab449c95d29` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:09.590523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fe370-e4fc-4392-953c-fb57b01c7e2e admin admin] RBAC: Authorizing `identity:get_user(user_id=afb1e9b4dc2b4c36880beab449c95d29)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:09.592976 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fe370-e4fc-4392-953c-fb57b01c7e2e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:09.595668 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 50/101] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:09 2022] GET /identity/v3/users/afb1e9b4dc2b4c36880beab449c95d29 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:09.601311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f55e5-7bf9-4c53-bb67-abcbfd09107f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:09.611660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f55e5-7bf9-4c53-bb67-abcbfd09107f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:09.620857 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26cea4-caa1-4ed0-97b5-633325dab6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:09.621990 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26cea4-caa1-4ed0-97b5-633325dab6ae admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:09.622478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26cea4-caa1-4ed0-97b5-633325dab6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:09.622931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26cea4-caa1-4ed0-97b5-633325dab6ae admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:09.624315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26cea4-caa1-4ed0-97b5-633325dab6ae admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:09.627434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26cea4-caa1-4ed0-97b5-633325dab6ae admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:09.629314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 52/102] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:09 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:09.635139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fe370-e4fc-4392-953c-fb57b01c7e2e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:09.646103 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fe370-e4fc-4392-953c-fb57b01c7e2e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:09.654679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7bb77-469e-4adf-8762-5156c37fd704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:09.655938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7bb77-469e-4adf-8762-5156c37fd704 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:09.656422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7bb77-469e-4adf-8762-5156c37fd704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:09.656915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7bb77-469e-4adf-8762-5156c37fd704 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2/users/afb1e9b4dc2b4c36880beab449c95d29/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:09.659317 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7bb77-469e-4adf-8762-5156c37fd704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4f1a5a685848d5bd703ae910481be2, user_id=afb1e9b4dc2b4c36880beab449c95d29, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:09.660600 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-02f7bb77-469e-4adf-8762-5156c37fd704 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:09.660600 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:25:09.660600 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:25:09.662990 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7bb77-469e-4adf-8762-5156c37fd704 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:09.699815 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 51/103] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:09 2022] PUT /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2/users/afb1e9b4dc2b4c36880beab449c95d29/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:09.734746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1e16c-20a1-489c-bf2f-73b11f6645e2 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:09.735312 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1e16c-20a1-489c-bf2f-73b11f6645e2 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:09.735794 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1e16c-20a1-489c-bf2f-73b11f6645e2 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:09.737759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 53/104] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:09.753322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ceefa-4dd9-475b-9c1b-51ae1bc8a4ca None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:09.753897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ceefa-4dd9-475b-9c1b-51ae1bc8a4ca None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:09.754402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ceefa-4dd9-475b-9c1b-51ae1bc8a4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:09.779026 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-897ceefa-4dd9-475b-9c1b-51ae1bc8a4ca None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:09.780560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-897ceefa-4dd9-475b-9c1b-51ae1bc8a4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:09.863309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 52/105] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:09.919795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1e16c-20a1-489c-bf2f-73b11f6645e2 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:09.938786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1e16c-20a1-489c-bf2f-73b11f6645e2 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:09.943702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bd80e-ebcf-4c2c-86a6-8ac0458ca414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:09.944793 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bd80e-ebcf-4c2c-86a6-8ac0458ca414 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:09.945280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bd80e-ebcf-4c2c-86a6-8ac0458ca414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:09.945753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bd80e-ebcf-4c2c-86a6-8ac0458ca414 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:09.964078 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bd80e-ebcf-4c2c-86a6-8ac0458ca414 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:09.971459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-224bd80e-ebcf-4c2c-86a6-8ac0458ca414 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:25:09.973044 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 54/106] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:25:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:09.979186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ceefa-4dd9-475b-9c1b-51ae1bc8a4ca None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:09.989323 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ceefa-4dd9-475b-9c1b-51ae1bc8a4ca None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:09.998233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f720c6-3a15-4ada-b846-936345174144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:09.999291 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f720c6-3a15-4ada-b846-936345174144 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:09.999774 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f720c6-3a15-4ada-b846-936345174144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.001057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f720c6-3a15-4ada-b846-936345174144 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.002015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f720c6-3a15-4ada-b846-936345174144 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:10.002552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f720c6-3a15-4ada-b846-936345174144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:10.004484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f720c6-3a15-4ada-b846-936345174144 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:10.016463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 53/107] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:10.022404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bd80e-ebcf-4c2c-86a6-8ac0458ca414 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.033929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bd80e-ebcf-4c2c-86a6-8ac0458ca414 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.038838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bcee2-3e55-4b06-ae7c-2c0f87887a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.040050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bcee2-3e55-4b06-ae7c-2c0f87887a24 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.040537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bcee2-3e55-4b06-ae7c-2c0f87887a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.041008 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bcee2-3e55-4b06-ae7c-2c0f87887a24 admin admin] PATH_INFO: `/v3/users/100e11f767f7472887d51a9dc7231480` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.042592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bcee2-3e55-4b06-ae7c-2c0f87887a24 admin admin] RBAC: Authorizing `identity:get_user(user_id=100e11f767f7472887d51a9dc7231480)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:10.044707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bcee2-3e55-4b06-ae7c-2c0f87887a24 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:10.047152 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 55/108] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:10 2022] GET /identity/v3/users/100e11f767f7472887d51a9dc7231480 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:10.055366 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f720c6-3a15-4ada-b846-936345174144 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.066282 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f720c6-3a15-4ada-b846-936345174144 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.072539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e90d22-c362-4e66-b022-62f056d6df39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.073722 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e90d22-c362-4e66-b022-62f056d6df39 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.074229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e90d22-c362-4e66-b022-62f056d6df39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.074774 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e90d22-c362-4e66-b022-62f056d6df39 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.076510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3a89b-55ad-4749-bb6f-06b81c39f3d2 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.077016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3a89b-55ad-4749-bb6f-06b81c39f3d2 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.077581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3a89b-55ad-4749-bb6f-06b81c39f3d2 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.080186 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 56/109] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:10.081812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e90d22-c362-4e66-b022-62f056d6df39 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:10.084262 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e90d22-c362-4e66-b022-62f056d6df39 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:10.085751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2705aa2-018a-4660-85ae-528de206f8bc None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.086260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2705aa2-018a-4660-85ae-528de206f8bc None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.086805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2705aa2-018a-4660-85ae-528de206f8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.092424 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 54/110] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:10 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:10.100267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e90d22-c362-4e66-b022-62f056d6df39 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.118287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e90d22-c362-4e66-b022-62f056d6df39 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.123925 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-e2705aa2-018a-4660-85ae-528de206f8bc None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:10.125949 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e2705aa2-018a-4660-85ae-528de206f8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:10.131475 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03651682-1856-4d85-9843-19773e735f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.132664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03651682-1856-4d85-9843-19773e735f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.133186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03651682-1856-4d85-9843-19773e735f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.133687 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03651682-1856-4d85-9843-19773e735f5d admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2/users/100e11f767f7472887d51a9dc7231480/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.137156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03651682-1856-4d85-9843-19773e735f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4f1a5a685848d5bd703ae910481be2, user_id=100e11f767f7472887d51a9dc7231480, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:10.145610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 57/111] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:10.146090 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03651682-1856-4d85-9843-19773e735f5d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:10.175884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2705aa2-018a-4660-85ae-528de206f8bc None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.189374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 55/112] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:10 2022] PUT /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2/users/100e11f767f7472887d51a9dc7231480/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:10.192100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2705aa2-018a-4660-85ae-528de206f8bc None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.198843 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b2627-287b-4c65-81c9-623ef942da3b None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.199147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b2627-287b-4c65-81c9-623ef942da3b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.199580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b2627-287b-4c65-81c9-623ef942da3b None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.202762 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 56/113] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:10.220279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3cc5-9006-4fc5-b23a-545439a5c94c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.220600 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3cc5-9006-4fc5-b23a-545439a5c94c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.220834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3cc5-9006-4fc5-b23a-545439a5c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.253392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-3a2e3cc5-9006-4fc5-b23a-545439a5c94c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:10.257473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3a2e3cc5-9006-4fc5-b23a-545439a5c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:10.319043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d55651-5fc6-4a84-90a9-9cacbe756f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.319881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d55651-5fc6-4a84-90a9-9cacbe756f86 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.320169 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d55651-5fc6-4a84-90a9-9cacbe756f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.320453 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d55651-5fc6-4a84-90a9-9cacbe756f86 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.335841 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d55651-5fc6-4a84-90a9-9cacbe756f86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:10.348782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-14d55651-5fc6-4a84-90a9-9cacbe756f86 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:10.354449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 58/114] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:10.359207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d55651-5fc6-4a84-90a9-9cacbe756f86 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.372035 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d55651-5fc6-4a84-90a9-9cacbe756f86 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.384043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca60b9-74d0-4396-8cfb-9315aab3840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.384742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca60b9-74d0-4396-8cfb-9315aab3840e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.385028 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca60b9-74d0-4396-8cfb-9315aab3840e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.385307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca60b9-74d0-4396-8cfb-9315aab3840e admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.386079 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca60b9-74d0-4396-8cfb-9315aab3840e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:10.386412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca60b9-74d0-4396-8cfb-9315aab3840e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:10.388225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca60b9-74d0-4396-8cfb-9315aab3840e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:10.404574 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 57/115] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:10.405556 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 59/116] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:10.411150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e3cc5-9006-4fc5-b23a-545439a5c94c None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.423554 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e3cc5-9006-4fc5-b23a-545439a5c94c None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.431195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b733-7601-45bb-8afc-aad9f9aeaa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.432024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b733-7601-45bb-8afc-aad9f9aeaa67 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.432311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b733-7601-45bb-8afc-aad9f9aeaa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.432583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b733-7601-45bb-8afc-aad9f9aeaa67 admin admin] PATH_INFO: `/v3/users/afb1e9b4dc2b4c36880beab449c95d29` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.436241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304b733-7601-45bb-8afc-aad9f9aeaa67 admin admin] RBAC: Authorizing `identity:get_user(user_id=afb1e9b4dc2b4c36880beab449c95d29)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:10.439085 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304b733-7601-45bb-8afc-aad9f9aeaa67 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:10.440761 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 58/117] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:10 2022] GET /identity/v3/users/afb1e9b4dc2b4c36880beab449c95d29 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:10.446181 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b733-7601-45bb-8afc-aad9f9aeaa67 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.446380 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca60b9-74d0-4396-8cfb-9315aab3840e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.459846 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca60b9-74d0-4396-8cfb-9315aab3840e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.461715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b733-7601-45bb-8afc-aad9f9aeaa67 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.465275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc8947-2dd2-406f-a4b5-98783fdb2465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.466137 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc8947-2dd2-406f-a4b5-98783fdb2465 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.466472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc8947-2dd2-406f-a4b5-98783fdb2465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.466753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc8947-2dd2-406f-a4b5-98783fdb2465 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.468733 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc8947-2dd2-406f-a4b5-98783fdb2465 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:10.470911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e763d6e-5cd3-45e7-b522-fda5edbea878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.471151 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc8947-2dd2-406f-a4b5-98783fdb2465 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:10.471702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e763d6e-5cd3-45e7-b522-fda5edbea878 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.471987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e763d6e-5cd3-45e7-b522-fda5edbea878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.472264 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e763d6e-5cd3-45e7-b522-fda5edbea878 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.472952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 60/118] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:10 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:10.483431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc8947-2dd2-406f-a4b5-98783fdb2465 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.489880 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e763d6e-5cd3-45e7-b522-fda5edbea878 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:10.497510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc8947-2dd2-406f-a4b5-98783fdb2465 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.510395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-8e763d6e-5cd3-45e7-b522-fda5edbea878 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:10.512043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 59/119] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:10.518078 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e763d6e-5cd3-45e7-b522-fda5edbea878 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.518877 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f0bfa-4cb5-4c53-9392-22b96dd299c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.519789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f0bfa-4cb5-4c53-9392-22b96dd299c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.520077 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f0bfa-4cb5-4c53-9392-22b96dd299c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.520354 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f0bfa-4cb5-4c53-9392-22b96dd299c5 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2/users/afb1e9b4dc2b4c36880beab449c95d29/roles/289d1250826d4384990c8f3d403bc047` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.531618 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f0bfa-4cb5-4c53-9392-22b96dd299c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4f1a5a685848d5bd703ae910481be2, user_id=afb1e9b4dc2b4c36880beab449c95d29, role_id=289d1250826d4384990c8f3d403bc047)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:10.534343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f0bfa-4cb5-4c53-9392-22b96dd299c5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:10.538468 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e763d6e-5cd3-45e7-b522-fda5edbea878 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.547300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754aac6-37b0-4ba0-827b-6fc3039c87e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.548006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754aac6-37b0-4ba0-827b-6fc3039c87e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.548291 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754aac6-37b0-4ba0-827b-6fc3039c87e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.552578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754aac6-37b0-4ba0-827b-6fc3039c87e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.552578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754aac6-37b0-4ba0-827b-6fc3039c87e1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:10.552578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754aac6-37b0-4ba0-827b-6fc3039c87e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:10.552578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754aac6-37b0-4ba0-827b-6fc3039c87e1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:10.568410 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 60/120] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:10.574681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754aac6-37b0-4ba0-827b-6fc3039c87e1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.577174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 61/121] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:10 2022] PUT /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2/users/afb1e9b4dc2b4c36880beab449c95d29/roles/289d1250826d4384990c8f3d403bc047 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:25:10.592232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754aac6-37b0-4ba0-827b-6fc3039c87e1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.677969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5fb4-3622-4cfb-9d37-f60467ff2f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.677969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5fb4-3622-4cfb-9d37-f60467ff2f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.677969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5fb4-3622-4cfb-9d37-f60467ff2f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.677969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5fb4-3622-4cfb-9d37-f60467ff2f73 admin admin] PATH_INFO: `/v3/users/afb1e9b4dc2b4c36880beab449c95d29` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.679370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b5fb4-3622-4cfb-9d37-f60467ff2f73 admin admin] RBAC: Authorizing `identity:get_user(user_id=afb1e9b4dc2b4c36880beab449c95d29)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:10.681803 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b5fb4-3622-4cfb-9d37-f60467ff2f73 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:10.683723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 61/122] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:10 2022] GET /identity/v3/users/afb1e9b4dc2b4c36880beab449c95d29 => generated 275 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:10.690105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f0bfa-4cb5-4c53-9392-22b96dd299c5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.712932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f0bfa-4cb5-4c53-9392-22b96dd299c5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.726902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c87318-082a-427e-b1bb-12d2a93db9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.727780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c87318-082a-427e-b1bb-12d2a93db9af admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.728067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c87318-082a-427e-b1bb-12d2a93db9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.728344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c87318-082a-427e-b1bb-12d2a93db9af admin admin] PATH_INFO: `/v3/projects/df582b65bcd84f9e8ab8765906d76f48` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.729562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c87318-082a-427e-b1bb-12d2a93db9af admin admin] RBAC: Authorizing `identity:get_project(project_id=df582b65bcd84f9e8ab8765906d76f48)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:10.731699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c87318-082a-427e-b1bb-12d2a93db9af admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:10.733425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 62/123] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:10 2022] GET /identity/v3/projects/df582b65bcd84f9e8ab8765906d76f48 => generated 312 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:10.739942 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5fb4-3622-4cfb-9d37-f60467ff2f73 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:10.751465 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5fb4-3622-4cfb-9d37-f60467ff2f73 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:10.762447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5e880-f0d3-4785-bb97-d729a5c7b7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:10.763667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5e880-f0d3-4785-bb97-d729a5c7b7a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.764196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5e880-f0d3-4785-bb97-d729a5c7b7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.764698 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5e880-f0d3-4785-bb97-d729a5c7b7a3 admin admin] PATH_INFO: `/v3/projects/df582b65bcd84f9e8ab8765906d76f48/users/afb1e9b4dc2b4c36880beab449c95d29/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.767778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5e880-f0d3-4785-bb97-d729a5c7b7a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df582b65bcd84f9e8ab8765906d76f48, user_id=afb1e9b4dc2b4c36880beab449c95d29, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:10.770921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5e880-f0d3-4785-bb97-d729a5c7b7a3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:10.804467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 62/124] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:10 2022] PUT /identity/v3/projects/df582b65bcd84f9e8ab8765906d76f48/users/afb1e9b4dc2b4c36880beab449c95d29/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:10.930653 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec6256-d768-4d4c-b99e-24972bf424e8 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.931001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec6256-d768-4d4c-b99e-24972bf424e8 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.931214 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec6256-d768-4d4c-b99e-24972bf424e8 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.933334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 63/125] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:10.950124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9870-f0ae-42c1-b058-946773de9882 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:10.950790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9870-f0ae-42c1-b058-946773de9882 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:10.951300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9870-f0ae-42c1-b058-946773de9882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:10.977640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-53fb9870-f0ae-42c1-b058-946773de9882 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:10.979230 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-53fb9870-f0ae-42c1-b058-946773de9882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:11.053259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 63/126] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:11.094334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec6256-d768-4d4c-b99e-24972bf424e8 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:11.127034 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec6256-d768-4d4c-b99e-24972bf424e8 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:11.132611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f09a24-4b2c-44eb-bbe0-d9970065357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:11.133423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f09a24-4b2c-44eb-bbe0-d9970065357f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:11.133705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f09a24-4b2c-44eb-bbe0-d9970065357f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:11.133978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f09a24-4b2c-44eb-bbe0-d9970065357f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:11.152477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f09a24-4b2c-44eb-bbe0-d9970065357f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:11.159947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-d5f09a24-4b2c-44eb-bbe0-d9970065357f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:25:11.161178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 64/127] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:11.167541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb9870-f0ae-42c1-b058-946773de9882 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:11.178626 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb9870-f0ae-42c1-b058-946773de9882 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:11.190350 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcf0ef-7078-49a9-8444-72c9dadeac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:11.191417 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcf0ef-7078-49a9-8444-72c9dadeac3c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:11.191915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcf0ef-7078-49a9-8444-72c9dadeac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:11.192413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcf0ef-7078-49a9-8444-72c9dadeac3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:11.193396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcf0ef-7078-49a9-8444-72c9dadeac3c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:11.193906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcf0ef-7078-49a9-8444-72c9dadeac3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:11.195798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcf0ef-7078-49a9-8444-72c9dadeac3c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:11.209159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 64/128] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:11.214768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f09a24-4b2c-44eb-bbe0-d9970065357f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:11.228366 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f09a24-4b2c-44eb-bbe0-d9970065357f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:11.233904 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb5b87-822c-41d5-b6a3-5e63e4b93b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:11.235364 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5b87-822c-41d5-b6a3-5e63e4b93b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:11.235645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5b87-822c-41d5-b6a3-5e63e4b93b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:11.235920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5b87-822c-41d5-b6a3-5e63e4b93b95 admin admin] PATH_INFO: `/v3/users/e0ec3a4302fe44adb3a39c786883fe00` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:11.258569 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb5b87-822c-41d5-b6a3-5e63e4b93b95 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0ec3a4302fe44adb3a39c786883fe00)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:11.262488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb5b87-822c-41d5-b6a3-5e63e4b93b95 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:11.266007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 65/129] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:11 2022] GET /identity/v3/users/e0ec3a4302fe44adb3a39c786883fe00 => generated 289 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:11.270661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcf0ef-7078-49a9-8444-72c9dadeac3c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:11.289986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcf0ef-7078-49a9-8444-72c9dadeac3c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:11.302909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687f8b7-c322-4f2d-9493-b80fa8fb439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:11.303927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687f8b7-c322-4f2d-9493-b80fa8fb439d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:11.304417 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687f8b7-c322-4f2d-9493-b80fa8fb439d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:11.304897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687f8b7-c322-4f2d-9493-b80fa8fb439d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:11.314410 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687f8b7-c322-4f2d-9493-b80fa8fb439d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:11.316584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687f8b7-c322-4f2d-9493-b80fa8fb439d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:11.332559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 65/130] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:11.338320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb5b87-822c-41d5-b6a3-5e63e4b93b95 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:11.351617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb5b87-822c-41d5-b6a3-5e63e4b93b95 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:11.367742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dff87-33cf-4926-ab94-c90a17eda509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:11.368669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dff87-33cf-4926-ab94-c90a17eda509 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:11.368956 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dff87-33cf-4926-ab94-c90a17eda509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:11.369232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dff87-33cf-4926-ab94-c90a17eda509 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:11.370448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dff87-33cf-4926-ab94-c90a17eda509 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:11.372494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dff87-33cf-4926-ab94-c90a17eda509 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:11.376080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 66/131] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:11 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:11.380823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687f8b7-c322-4f2d-9493-b80fa8fb439d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:11.390578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687f8b7-c322-4f2d-9493-b80fa8fb439d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:11.401971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0cb01-8e9e-46aa-ac6a-5c0b59f0745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:11.403013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0cb01-8e9e-46aa-ac6a-5c0b59f0745a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:11.403505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0cb01-8e9e-46aa-ac6a-5c0b59f0745a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:11.403999 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0cb01-8e9e-46aa-ac6a-5c0b59f0745a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:11.405039 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0cb01-8e9e-46aa-ac6a-5c0b59f0745a admin admin] RBAC: Adding query filter params (role.id=093e9332cf3845ada22785bdc1b21626, scope.project.id=3c4f1a5a685848d5bd703ae910481be2, user.id=e0ec3a4302fe44adb3a39c786883fe00) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:11.405983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0cb01-8e9e-46aa-ac6a-5c0b59f0745a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:11.408112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0cb01-8e9e-46aa-ac6a-5c0b59f0745a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:11.418638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 66/132] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:11 2022] GET /identity/v3/role_assignments?user.id=e0ec3a4302fe44adb3a39c786883fe00&scope.project.id=3c4f1a5a685848d5bd703ae910481be2&role.id=093e9332cf3845ada22785bdc1b21626 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:11.772210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2afeb0-6e4c-4cd0-a585-bffc0eae7ea9 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:11.772720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2afeb0-6e4c-4cd0-a585-bffc0eae7ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:11.772792 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2afeb0-6e4c-4cd0-a585-bffc0eae7ea9 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:11.774996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 67/133] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:11.799614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738603eb-3980-491d-a61e-4d4786eec596 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:11.799614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738603eb-3980-491d-a61e-4d4786eec596 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:11.799614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738603eb-3980-491d-a61e-4d4786eec596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:11.831443 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-738603eb-3980-491d-a61e-4d4786eec596 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:11.832983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-738603eb-3980-491d-a61e-4d4786eec596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:11.843967 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 67/134] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:11.900878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2afeb0-6e4c-4cd0-a585-bffc0eae7ea9 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:11.924175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2afeb0-6e4c-4cd0-a585-bffc0eae7ea9 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:11.931990 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47bc4d-a752-428a-994e-2ebac2a8165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:11.932782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47bc4d-a752-428a-994e-2ebac2a8165d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:11.933065 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47bc4d-a752-428a-994e-2ebac2a8165d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:11.933341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47bc4d-a752-428a-994e-2ebac2a8165d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:11.934534 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47bc4d-a752-428a-994e-2ebac2a8165d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:11.936233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47bc4d-a752-428a-994e-2ebac2a8165d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:11.938126 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 68/135] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:11.944863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738603eb-3980-491d-a61e-4d4786eec596 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:11.959744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738603eb-3980-491d-a61e-4d4786eec596 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:11.980292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80624dd5-c390-4711-bc08-8dd7a9d7e4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:11.981282 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80624dd5-c390-4711-bc08-8dd7a9d7e4db admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:11.981869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80624dd5-c390-4711-bc08-8dd7a9d7e4db admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:11.982406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80624dd5-c390-4711-bc08-8dd7a9d7e4db admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:11.983332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80624dd5-c390-4711-bc08-8dd7a9d7e4db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:11.986101 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80624dd5-c390-4711-bc08-8dd7a9d7e4db admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:12.037539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 68/136] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:25:11 2022] POST /identity/v3/projects => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:13.233323 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa0fe5-8403-4cd7-bb9f-00ade700dc7c None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.233869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa0fe5-8403-4cd7-bb9f-00ade700dc7c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.233869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa0fe5-8403-4cd7-bb9f-00ade700dc7c None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.235713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 69/137] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:13.240928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956badb-c7cf-445a-a089-13ef37459ff8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.241346 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956badb-c7cf-445a-a089-13ef37459ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.241520 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956badb-c7cf-445a-a089-13ef37459ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.263150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-8956badb-c7cf-445a-a089-13ef37459ff8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:13.264329 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8956badb-c7cf-445a-a089-13ef37459ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:13.334292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 69/138] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:13.358521 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa0fe5-8403-4cd7-bb9f-00ade700dc7c None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:13.374455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa0fe5-8403-4cd7-bb9f-00ade700dc7c None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:13.384107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461a09-efaf-4f4a-b690-ec816a0ab397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:13.384902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461a09-efaf-4f4a-b690-ec816a0ab397 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.385190 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461a09-efaf-4f4a-b690-ec816a0ab397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.385468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461a09-efaf-4f4a-b690-ec816a0ab397 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.398976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53461a09-efaf-4f4a-b690-ec816a0ab397 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:13.405782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-53461a09-efaf-4f4a-b690-ec816a0ab397 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:13.407027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 70/139] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:13.412655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956badb-c7cf-445a-a089-13ef37459ff8 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:13.421587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956badb-c7cf-445a-a089-13ef37459ff8 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:13.430278 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce4265-6c7d-4fbe-80e8-cb3e90294122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:13.430951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce4265-6c7d-4fbe-80e8-cb3e90294122 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.431236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce4265-6c7d-4fbe-80e8-cb3e90294122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.431515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce4265-6c7d-4fbe-80e8-cb3e90294122 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.432279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce4265-6c7d-4fbe-80e8-cb3e90294122 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:13.432590 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce4265-6c7d-4fbe-80e8-cb3e90294122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:13.434244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce4265-6c7d-4fbe-80e8-cb3e90294122 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:13.443730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 70/140] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:13.449089 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461a09-efaf-4f4a-b690-ec816a0ab397 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:13.459967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461a09-efaf-4f4a-b690-ec816a0ab397 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:13.464402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef5a03-3af7-4dd6-bd64-9c4de60278f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:13.465263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef5a03-3af7-4dd6-bd64-9c4de60278f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.465550 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef5a03-3af7-4dd6-bd64-9c4de60278f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.465827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef5a03-3af7-4dd6-bd64-9c4de60278f5 admin admin] PATH_INFO: `/v3/users/afb1e9b4dc2b4c36880beab449c95d29` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.467089 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef5a03-3af7-4dd6-bd64-9c4de60278f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=afb1e9b4dc2b4c36880beab449c95d29)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:13.469324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef5a03-3af7-4dd6-bd64-9c4de60278f5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:13.470948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 71/141] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:13 2022] GET /identity/v3/users/afb1e9b4dc2b4c36880beab449c95d29 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:13.476248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce4265-6c7d-4fbe-80e8-cb3e90294122 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:13.489590 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce4265-6c7d-4fbe-80e8-cb3e90294122 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:13.494086 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c30fc-e90a-41db-91eb-6f01185c9be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:13.494770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c30fc-e90a-41db-91eb-6f01185c9be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.495056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c30fc-e90a-41db-91eb-6f01185c9be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.495343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c30fc-e90a-41db-91eb-6f01185c9be4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.507078 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c30fc-e90a-41db-91eb-6f01185c9be4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:13.508846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c30fc-e90a-41db-91eb-6f01185c9be4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:13.524407 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 71/142] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:13.530285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef5a03-3af7-4dd6-bd64-9c4de60278f5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:13.543550 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef5a03-3af7-4dd6-bd64-9c4de60278f5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:13.548188 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb62cb-afc0-4194-9ead-99d964bc2a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:13.549049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb62cb-afc0-4194-9ead-99d964bc2a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.549333 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb62cb-afc0-4194-9ead-99d964bc2a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.549610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb62cb-afc0-4194-9ead-99d964bc2a81 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.550835 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb62cb-afc0-4194-9ead-99d964bc2a81 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:13.552921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb62cb-afc0-4194-9ead-99d964bc2a81 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:13.554661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 72/143] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:13 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:13.560510 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c30fc-e90a-41db-91eb-6f01185c9be4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:13.570144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c30fc-e90a-41db-91eb-6f01185c9be4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:13.574927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c51db-0258-459c-823f-611b69f0c5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:13.575580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c51db-0258-459c-823f-611b69f0c5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.575924 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c51db-0258-459c-823f-611b69f0c5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.576207 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c51db-0258-459c-823f-611b69f0c5f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.577101 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c51db-0258-459c-823f-611b69f0c5f8 admin admin] RBAC: Adding query filter params (role.id=3d85c07c87374b898492488d6e608a27, scope.project.id=3c4f1a5a685848d5bd703ae910481be2, user.id=afb1e9b4dc2b4c36880beab449c95d29) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:13.577419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c51db-0258-459c-823f-611b69f0c5f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:13.579934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c51db-0258-459c-823f-611b69f0c5f8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:13.586087 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 72/144] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:13 2022] GET /identity/v3/role_assignments?user.id=afb1e9b4dc2b4c36880beab449c95d29&scope.project.id=3c4f1a5a685848d5bd703ae910481be2&role.id=3d85c07c87374b898492488d6e608a27 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:13.591813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad3688-771c-4444-9cf9-ea997a6e7473 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.592108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad3688-771c-4444-9cf9-ea997a6e7473 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.592387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad3688-771c-4444-9cf9-ea997a6e7473 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.594365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 73/145] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:13.602219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c2a94-8bb1-438b-86d3-ffef1fa2a9c3 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.602219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c2a94-8bb1-438b-86d3-ffef1fa2a9c3 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.602219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c2a94-8bb1-438b-86d3-ffef1fa2a9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.627513 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-fd2c2a94-8bb1-438b-86d3-ffef1fa2a9c3 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:13.629165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-fd2c2a94-8bb1-438b-86d3-ffef1fa2a9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:13.642153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 73/146] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:13.680522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad3688-771c-4444-9cf9-ea997a6e7473 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:13.698869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad3688-771c-4444-9cf9-ea997a6e7473 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:13.705894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c917b-16a0-4385-afde-ea7ee861248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:13.706738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c917b-16a0-4385-afde-ea7ee861248f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.707024 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c917b-16a0-4385-afde-ea7ee861248f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.707300 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c917b-16a0-4385-afde-ea7ee861248f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.720240 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c917b-16a0-4385-afde-ea7ee861248f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:13.727292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-657c917b-16a0-4385-afde-ea7ee861248f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:25:13.728818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 74/147] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:25:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:13.734381 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c2a94-8bb1-438b-86d3-ffef1fa2a9c3 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:13.748787 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c2a94-8bb1-438b-86d3-ffef1fa2a9c3 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:13.758612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da5880-aa14-4a9c-ad20-2cae6d9cf4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:13.759557 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da5880-aa14-4a9c-ad20-2cae6d9cf4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.759990 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da5880-aa14-4a9c-ad20-2cae6d9cf4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.760430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da5880-aa14-4a9c-ad20-2cae6d9cf4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.761352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da5880-aa14-4a9c-ad20-2cae6d9cf4b2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:13.761808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da5880-aa14-4a9c-ad20-2cae6d9cf4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:13.763601 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da5880-aa14-4a9c-ad20-2cae6d9cf4b2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:13.780717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 74/148] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:13.787193 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c917b-16a0-4385-afde-ea7ee861248f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:13.803780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c917b-16a0-4385-afde-ea7ee861248f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:13.810387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b006f-22b4-4f07-9fd3-cb2751f8b407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:13.811334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b006f-22b4-4f07-9fd3-cb2751f8b407 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.811678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b006f-22b4-4f07-9fd3-cb2751f8b407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.812007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b006f-22b4-4f07-9fd3-cb2751f8b407 admin admin] PATH_INFO: `/v3/users/100e11f767f7472887d51a9dc7231480` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.815055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b006f-22b4-4f07-9fd3-cb2751f8b407 admin admin] RBAC: Authorizing `identity:get_user(user_id=100e11f767f7472887d51a9dc7231480)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:13.816962 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b006f-22b4-4f07-9fd3-cb2751f8b407 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:13.819060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 75/149] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:13 2022] GET /identity/v3/users/100e11f767f7472887d51a9dc7231480 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:13.824408 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da5880-aa14-4a9c-ad20-2cae6d9cf4b2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:13.834731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da5880-aa14-4a9c-ad20-2cae6d9cf4b2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:13.846837 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c3af2-a59b-438a-af0c-a2f914da6581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:13.847887 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c3af2-a59b-438a-af0c-a2f914da6581 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.848400 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c3af2-a59b-438a-af0c-a2f914da6581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.848890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c3af2-a59b-438a-af0c-a2f914da6581 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.863251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c3af2-a59b-438a-af0c-a2f914da6581 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:13.865429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c3af2-a59b-438a-af0c-a2f914da6581 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:13.878677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 75/150] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:13.884435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b006f-22b4-4f07-9fd3-cb2751f8b407 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:13.908145 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b006f-22b4-4f07-9fd3-cb2751f8b407 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:13.916207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a5e7d-ee0c-445e-bcaf-b518b24fe9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:13.917124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a5e7d-ee0c-445e-bcaf-b518b24fe9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.917456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a5e7d-ee0c-445e-bcaf-b518b24fe9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.917745 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a5e7d-ee0c-445e-bcaf-b518b24fe9f1 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.919159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a5e7d-ee0c-445e-bcaf-b518b24fe9f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:13.921320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a5e7d-ee0c-445e-bcaf-b518b24fe9f1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:13.923620 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 76/151] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:13 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:13.929514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c3af2-a59b-438a-af0c-a2f914da6581 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:13.942128 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c3af2-a59b-438a-af0c-a2f914da6581 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:13.952701 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f32ed2-52e2-420e-8eac-0825f7443bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:13.953405 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f32ed2-52e2-420e-8eac-0825f7443bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:13.953692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f32ed2-52e2-420e-8eac-0825f7443bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:13.953971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f32ed2-52e2-420e-8eac-0825f7443bd5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:13.954849 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f32ed2-52e2-420e-8eac-0825f7443bd5 admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=3c4f1a5a685848d5bd703ae910481be2, user.id=100e11f767f7472887d51a9dc7231480) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:13.955160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f32ed2-52e2-420e-8eac-0825f7443bd5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:13.957241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f32ed2-52e2-420e-8eac-0825f7443bd5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:13.964006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 76/152] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:13 2022] GET /identity/v3/role_assignments?user.id=100e11f767f7472887d51a9dc7231480&scope.project.id=3c4f1a5a685848d5bd703ae910481be2&role.id=548abad662724741a3261205ee7cb828 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:14.066678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5c7db-91b4-41cb-bf69-607c7c1a4dbc None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.067331 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5c7db-91b4-41cb-bf69-607c7c1a4dbc None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.067822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5c7db-91b4-41cb-bf69-607c7c1a4dbc None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.069901 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 77/153] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:14.075774 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2dd1c-d5ae-4e65-9326-ed99b88c65cf None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.076068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2dd1c-d5ae-4e65-9326-ed99b88c65cf None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.076352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2dd1c-d5ae-4e65-9326-ed99b88c65cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.112894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-daa2dd1c-d5ae-4e65-9326-ed99b88c65cf None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:14.114094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-daa2dd1c-d5ae-4e65-9326-ed99b88c65cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:14.126626 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 77/154] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:14.167896 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5c7db-91b4-41cb-bf69-607c7c1a4dbc None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.184558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5c7db-91b4-41cb-bf69-607c7c1a4dbc None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.192086 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52f335-3d19-422b-844a-483db76bf380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.193261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f335-3d19-422b-844a-483db76bf380 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.193746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f335-3d19-422b-844a-483db76bf380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.194294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f335-3d19-422b-844a-483db76bf380 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.213265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52f335-3d19-422b-844a-483db76bf380 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:14.221943 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-9f52f335-3d19-422b-844a-483db76bf380 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:14.223909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 78/155] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:14.229943 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2dd1c-d5ae-4e65-9326-ed99b88c65cf None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.245853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2dd1c-d5ae-4e65-9326-ed99b88c65cf None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.254764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff4683-fe8c-449b-8ed5-5a52d2cf2e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.255447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff4683-fe8c-449b-8ed5-5a52d2cf2e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.255731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff4683-fe8c-449b-8ed5-5a52d2cf2e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.256010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff4683-fe8c-449b-8ed5-5a52d2cf2e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.256783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff4683-fe8c-449b-8ed5-5a52d2cf2e01 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:14.257091 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff4683-fe8c-449b-8ed5-5a52d2cf2e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:14.258738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff4683-fe8c-449b-8ed5-5a52d2cf2e01 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:14.271823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 78/156] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:14.277579 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52f335-3d19-422b-844a-483db76bf380 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.290321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52f335-3d19-422b-844a-483db76bf380 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.296847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ab0ff-a31e-4a9b-a179-1970af846452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.298369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ab0ff-a31e-4a9b-a179-1970af846452 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.298700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ab0ff-a31e-4a9b-a179-1970af846452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.299019 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ab0ff-a31e-4a9b-a179-1970af846452 admin admin] PATH_INFO: `/v3/users/afb1e9b4dc2b4c36880beab449c95d29` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.300714 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ab0ff-a31e-4a9b-a179-1970af846452 admin admin] RBAC: Authorizing `identity:get_user(user_id=afb1e9b4dc2b4c36880beab449c95d29)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:14.303099 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ab0ff-a31e-4a9b-a179-1970af846452 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:14.310257 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 79/157] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/users/afb1e9b4dc2b4c36880beab449c95d29 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:14.311502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff4683-fe8c-449b-8ed5-5a52d2cf2e01 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.327725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff4683-fe8c-449b-8ed5-5a52d2cf2e01 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.333533 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99672b52-ca96-45c9-8a74-64139ebf9d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.334226 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99672b52-ca96-45c9-8a74-64139ebf9d82 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.334527 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99672b52-ca96-45c9-8a74-64139ebf9d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.334808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99672b52-ca96-45c9-8a74-64139ebf9d82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.345640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99672b52-ca96-45c9-8a74-64139ebf9d82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:14.347577 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99672b52-ca96-45c9-8a74-64139ebf9d82 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:14.357470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 79/158] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:14.363646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ab0ff-a31e-4a9b-a179-1970af846452 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.380723 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ab0ff-a31e-4a9b-a179-1970af846452 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.387485 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce8a8b-88d8-4114-bbda-0262fcea891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.388650 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce8a8b-88d8-4114-bbda-0262fcea891e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.389131 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce8a8b-88d8-4114-bbda-0262fcea891e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.389585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce8a8b-88d8-4114-bbda-0262fcea891e admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.392087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce8a8b-88d8-4114-bbda-0262fcea891e admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:14.394413 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce8a8b-88d8-4114-bbda-0262fcea891e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:14.396350 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 80/159] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:14.402444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99672b52-ca96-45c9-8a74-64139ebf9d82 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.413114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99672b52-ca96-45c9-8a74-64139ebf9d82 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.420890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df5a35-ebbd-4e4b-8212-e378e448d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.421494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df5a35-ebbd-4e4b-8212-e378e448d9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.421780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df5a35-ebbd-4e4b-8212-e378e448d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.422687 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df5a35-ebbd-4e4b-8212-e378e448d9a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.423543 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df5a35-ebbd-4e4b-8212-e378e448d9a1 admin admin] RBAC: Adding query filter params (role.id=289d1250826d4384990c8f3d403bc047, scope.project.id=3c4f1a5a685848d5bd703ae910481be2, user.id=afb1e9b4dc2b4c36880beab449c95d29) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:14.423910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df5a35-ebbd-4e4b-8212-e378e448d9a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:14.425954 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df5a35-ebbd-4e4b-8212-e378e448d9a1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:14.432884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 80/160] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/role_assignments?user.id=afb1e9b4dc2b4c36880beab449c95d29&scope.project.id=3c4f1a5a685848d5bd703ae910481be2&role.id=289d1250826d4384990c8f3d403bc047 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:14.750455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347e24a-a798-4e3e-a2c3-2f8579b34ed2 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.750820 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347e24a-a798-4e3e-a2c3-2f8579b34ed2 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.751013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347e24a-a798-4e3e-a2c3-2f8579b34ed2 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.752925 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 81/161] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:14.757955 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc540de-975d-4f43-99cb-a21d33374cda None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.758272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc540de-975d-4f43-99cb-a21d33374cda None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.758560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc540de-975d-4f43-99cb-a21d33374cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.776745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-cbc540de-975d-4f43-99cb-a21d33374cda None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:14.777903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-cbc540de-975d-4f43-99cb-a21d33374cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:14.786146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 81/162] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:14.809624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347e24a-a798-4e3e-a2c3-2f8579b34ed2 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.821538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347e24a-a798-4e3e-a2c3-2f8579b34ed2 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.825674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1ef22-a4e1-4847-89bc-228df6382b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.826605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1ef22-a4e1-4847-89bc-228df6382b04 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.826830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1ef22-a4e1-4847-89bc-228df6382b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.827108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1ef22-a4e1-4847-89bc-228df6382b04 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.828097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9cc9d-d876-467e-8e16-ac27067b7000 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.828921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9cc9d-d876-467e-8e16-ac27067b7000 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.829195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9cc9d-d876-467e-8e16-ac27067b7000 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.831141 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 82/163] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:14.836052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543fb41-f1a2-4b53-bdec-3ff831abe50d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.836341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543fb41-f1a2-4b53-bdec-3ff831abe50d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.836620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543fb41-f1a2-4b53-bdec-3ff831abe50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.837941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1ef22-a4e1-4847-89bc-228df6382b04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:14.845417 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-15d1ef22-a4e1-4847-89bc-228df6382b04 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:14.846658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 82/164] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:14.852101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1ef22-a4e1-4847-89bc-228df6382b04 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.855549 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-c543fb41-f1a2-4b53-bdec-3ff831abe50d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:14.856961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c543fb41-f1a2-4b53-bdec-3ff831abe50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:14.861443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1ef22-a4e1-4847-89bc-228df6382b04 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.865322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 83/165] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:14.865724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9d46e-66b7-45a4-a2ad-3e14ef6b0591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.866395 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9d46e-66b7-45a4-a2ad-3e14ef6b0591 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.866677 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9d46e-66b7-45a4-a2ad-3e14ef6b0591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.866948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9d46e-66b7-45a4-a2ad-3e14ef6b0591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.867688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9d46e-66b7-45a4-a2ad-3e14ef6b0591 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:14.867990 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9d46e-66b7-45a4-a2ad-3e14ef6b0591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:14.869578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9d46e-66b7-45a4-a2ad-3e14ef6b0591 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:14.879743 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 83/166] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:14.884906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543fb41-f1a2-4b53-bdec-3ff831abe50d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.889288 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9d46e-66b7-45a4-a2ad-3e14ef6b0591 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.894957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543fb41-f1a2-4b53-bdec-3ff831abe50d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.899260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c82d02-fed0-47bb-b140-b427e1ebd680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.900116 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82d02-fed0-47bb-b140-b427e1ebd680 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.900399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82d02-fed0-47bb-b140-b427e1ebd680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.900665 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9d46e-66b7-45a4-a2ad-3e14ef6b0591 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.900763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82d02-fed0-47bb-b140-b427e1ebd680 admin admin] PATH_INFO: `/v3/users/afb1e9b4dc2b4c36880beab449c95d29` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.901849 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c82d02-fed0-47bb-b140-b427e1ebd680 admin admin] RBAC: Authorizing `identity:get_user(user_id=afb1e9b4dc2b4c36880beab449c95d29)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:14.904043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c82d02-fed0-47bb-b140-b427e1ebd680 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:14.905106 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af82d11-5a0d-45d4-b7b4-8a87fc9cf02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.905628 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 84/167] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/users/afb1e9b4dc2b4c36880beab449c95d29 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:14.906138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af82d11-5a0d-45d4-b7b4-8a87fc9cf02d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.907209 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af82d11-5a0d-45d4-b7b4-8a87fc9cf02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.907381 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af82d11-5a0d-45d4-b7b4-8a87fc9cf02d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.914254 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c82d02-fed0-47bb-b140-b427e1ebd680 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.920470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af82d11-5a0d-45d4-b7b4-8a87fc9cf02d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:14.925139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c82d02-fed0-47bb-b140-b427e1ebd680 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.929673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-8af82d11-5a0d-45d4-b7b4-8a87fc9cf02d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:25:14.929794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef961eb5-3636-4003-bbf7-79735ba4d345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.930452 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef961eb5-3636-4003-bbf7-79735ba4d345 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.930738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef961eb5-3636-4003-bbf7-79735ba4d345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.931192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 84/168] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:14.931290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef961eb5-3636-4003-bbf7-79735ba4d345 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.936635 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af82d11-5a0d-45d4-b7b4-8a87fc9cf02d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.939119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef961eb5-3636-4003-bbf7-79735ba4d345 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:14.940887 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef961eb5-3636-4003-bbf7-79735ba4d345 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:14.947881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af82d11-5a0d-45d4-b7b4-8a87fc9cf02d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.949581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 85/169] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:25:14.952555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ed981-33f0-45cc-87de-892e85be2687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.953428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ed981-33f0-45cc-87de-892e85be2687 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.953914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ed981-33f0-45cc-87de-892e85be2687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.954379 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ed981-33f0-45cc-87de-892e85be2687 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.954879 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef961eb5-3636-4003-bbf7-79735ba4d345 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.955456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ed981-33f0-45cc-87de-892e85be2687 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:14.955955 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ed981-33f0-45cc-87de-892e85be2687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:14.957834 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ed981-33f0-45cc-87de-892e85be2687 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:14.964444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef961eb5-3636-4003-bbf7-79735ba4d345 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.967777 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 85/170] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:14.973391 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54ec03-6e22-4498-a3c1-65a71ac50b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.973800 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ed981-33f0-45cc-87de-892e85be2687 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.974334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54ec03-6e22-4498-a3c1-65a71ac50b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.974647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54ec03-6e22-4498-a3c1-65a71ac50b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.974921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54ec03-6e22-4498-a3c1-65a71ac50b71 admin admin] PATH_INFO: `/v3/projects/df582b65bcd84f9e8ab8765906d76f48` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.976114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54ec03-6e22-4498-a3c1-65a71ac50b71 admin admin] RBAC: Authorizing `identity:get_project(project_id=df582b65bcd84f9e8ab8765906d76f48)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:14.978162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54ec03-6e22-4498-a3c1-65a71ac50b71 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:14.979994 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 86/171] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/projects/df582b65bcd84f9e8ab8765906d76f48 => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:14.985475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ed981-33f0-45cc-87de-892e85be2687 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.985928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54ec03-6e22-4498-a3c1-65a71ac50b71 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:14.989857 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32381781-83f6-480e-9701-7a37d67c107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:14.990936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381781-83f6-480e-9701-7a37d67c107a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:14.991227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381781-83f6-480e-9701-7a37d67c107a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:14.991500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381781-83f6-480e-9701-7a37d67c107a admin admin] PATH_INFO: `/v3/users/e0ec3a4302fe44adb3a39c786883fe00` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:14.993485 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32381781-83f6-480e-9701-7a37d67c107a admin admin] RBAC: Authorizing `identity:get_user(user_id=e0ec3a4302fe44adb3a39c786883fe00)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:14.995260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54ec03-6e22-4498-a3c1-65a71ac50b71 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:14.995706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32381781-83f6-480e-9701-7a37d67c107a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:14.998493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 86/172] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/users/e0ec3a4302fe44adb3a39c786883fe00 => generated 289 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:15.003025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32381781-83f6-480e-9701-7a37d67c107a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:15.004013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c1e4f-44e0-4a1d-82bb-480490a4bd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:15.004668 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c1e4f-44e0-4a1d-82bb-480490a4bd11 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:15.004955 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c1e4f-44e0-4a1d-82bb-480490a4bd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:15.005232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c1e4f-44e0-4a1d-82bb-480490a4bd11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:15.006081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c1e4f-44e0-4a1d-82bb-480490a4bd11 admin admin] RBAC: Adding query filter params (role.id=3d85c07c87374b898492488d6e608a27, scope.project.id=df582b65bcd84f9e8ab8765906d76f48, user.id=afb1e9b4dc2b4c36880beab449c95d29) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:15.006444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c1e4f-44e0-4a1d-82bb-480490a4bd11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:15.008324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c1e4f-44e0-4a1d-82bb-480490a4bd11 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:15.015285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 87/173] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:14 2022] GET /identity/v3/role_assignments?user.id=afb1e9b4dc2b4c36880beab449c95d29&scope.project.id=df582b65bcd84f9e8ab8765906d76f48&role.id=3d85c07c87374b898492488d6e608a27 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:15.015465 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32381781-83f6-480e-9701-7a37d67c107a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:15.020600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d30de-7c33-404a-9e01-8c933af4779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:15.021487 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d30de-7c33-404a-9e01-8c933af4779f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:15.021773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d30de-7c33-404a-9e01-8c933af4779f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:15.022080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d30de-7c33-404a-9e01-8c933af4779f admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:15.023386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d30de-7c33-404a-9e01-8c933af4779f admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:15.025519 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d30de-7c33-404a-9e01-8c933af4779f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:15.027559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 87/174] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:15 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:15.033894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c1e4f-44e0-4a1d-82bb-480490a4bd11 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:15.044097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c1e4f-44e0-4a1d-82bb-480490a4bd11 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:15.049183 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f956d6-1093-42db-97ef-e59a2d776f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:15.050097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f956d6-1093-42db-97ef-e59a2d776f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:15.050418 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f956d6-1093-42db-97ef-e59a2d776f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:15.050763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f956d6-1093-42db-97ef-e59a2d776f14 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2/users/e0ec3a4302fe44adb3a39c786883fe00/roles/093e9332cf3845ada22785bdc1b21626` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:15.052843 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f956d6-1093-42db-97ef-e59a2d776f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4f1a5a685848d5bd703ae910481be2, user_id=e0ec3a4302fe44adb3a39c786883fe00, role_id=093e9332cf3845ada22785bdc1b21626)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:15.055606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f956d6-1093-42db-97ef-e59a2d776f14 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:15.070153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 88/175] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:15 2022] PUT /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2/users/e0ec3a4302fe44adb3a39c786883fe00/roles/093e9332cf3845ada22785bdc1b21626 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:15.546986 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85858f0-2ae3-46b1-bde9-b5b528cb9a52 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:15.547503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85858f0-2ae3-46b1-bde9-b5b528cb9a52 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:15.547585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85858f0-2ae3-46b1-bde9-b5b528cb9a52 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:15.549299 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 88/176] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:15.554386 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670646e-1ebf-4a0b-964f-8c10a943eb64 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:15.554759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670646e-1ebf-4a0b-964f-8c10a943eb64 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:15.555047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670646e-1ebf-4a0b-964f-8c10a943eb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:15.572584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f670646e-1ebf-4a0b-964f-8c10a943eb64 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:15.573724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f670646e-1ebf-4a0b-964f-8c10a943eb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:15.629121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 89/177] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:15.653640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85858f0-2ae3-46b1-bde9-b5b528cb9a52 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:15.665363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85858f0-2ae3-46b1-bde9-b5b528cb9a52 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:15.669498 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a303e-7742-4080-9516-6fb2ba8afb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:15.670298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a303e-7742-4080-9516-6fb2ba8afb6a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:15.670584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a303e-7742-4080-9516-6fb2ba8afb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:15.670856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a303e-7742-4080-9516-6fb2ba8afb6a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:15.672023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a303e-7742-4080-9516-6fb2ba8afb6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:15.673712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a303e-7742-4080-9516-6fb2ba8afb6a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:15.675292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 89/178] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:15.680198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670646e-1ebf-4a0b-964f-8c10a943eb64 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:15.689324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670646e-1ebf-4a0b-964f-8c10a943eb64 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:15.693553 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12156e04-f83a-4120-a5b2-708874289484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:15.694196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12156e04-f83a-4120-a5b2-708874289484 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:15.694507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12156e04-f83a-4120-a5b2-708874289484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:15.694777 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12156e04-f83a-4120-a5b2-708874289484 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:15.695492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12156e04-f83a-4120-a5b2-708874289484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:15.697406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12156e04-f83a-4120-a5b2-708874289484 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:15.716110 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 90/179] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:25:15 2022] POST /identity/v3/users => generated 283 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:17.417622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005c728-c448-481c-bccb-40f3a280c393 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:17.418116 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005c728-c448-481c-bccb-40f3a280c393 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:17.418116 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005c728-c448-481c-bccb-40f3a280c393 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:17.420100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 90/180] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:17.425491 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11ce44-e896-45df-9f7e-818a5c085e39 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:17.425897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11ce44-e896-45df-9f7e-818a5c085e39 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:17.426084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11ce44-e896-45df-9f7e-818a5c085e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:17.444012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-1a11ce44-e896-45df-9f7e-818a5c085e39 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:17.445172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-1a11ce44-e896-45df-9f7e-818a5c085e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:17.452677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 91/181] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:17.476391 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005c728-c448-481c-bccb-40f3a280c393 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:17.488987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005c728-c448-481c-bccb-40f3a280c393 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:17.493248 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43672a6-2ed9-455f-8664-9b7e359d9b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:17.494020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43672a6-2ed9-455f-8664-9b7e359d9b66 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:17.494325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43672a6-2ed9-455f-8664-9b7e359d9b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:17.494596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43672a6-2ed9-455f-8664-9b7e359d9b66 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:17.505765 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43672a6-2ed9-455f-8664-9b7e359d9b66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:17.512641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-e43672a6-2ed9-455f-8664-9b7e359d9b66 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:25:17.514044 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 91/182] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:17.519605 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11ce44-e896-45df-9f7e-818a5c085e39 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:17.528447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11ce44-e896-45df-9f7e-818a5c085e39 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:17.532889 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711ed41-6f8b-4b2e-8cd7-06408b145f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:17.533543 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711ed41-6f8b-4b2e-8cd7-06408b145f57 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:17.533819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711ed41-6f8b-4b2e-8cd7-06408b145f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:17.534083 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711ed41-6f8b-4b2e-8cd7-06408b145f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:17.534865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711ed41-6f8b-4b2e-8cd7-06408b145f57 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:17.535165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711ed41-6f8b-4b2e-8cd7-06408b145f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:17.536776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711ed41-6f8b-4b2e-8cd7-06408b145f57 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:17.545181 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 92/183] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:17.551180 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43672a6-2ed9-455f-8664-9b7e359d9b66 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:17.561297 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43672a6-2ed9-455f-8664-9b7e359d9b66 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:17.567070 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972047b9-0c5c-4198-9081-86e6ec627461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:17.567928 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972047b9-0c5c-4198-9081-86e6ec627461 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:17.568205 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972047b9-0c5c-4198-9081-86e6ec627461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:17.568476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972047b9-0c5c-4198-9081-86e6ec627461 admin admin] PATH_INFO: `/v3/users/e0ec3a4302fe44adb3a39c786883fe00` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:17.569731 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972047b9-0c5c-4198-9081-86e6ec627461 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0ec3a4302fe44adb3a39c786883fe00)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:17.571889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972047b9-0c5c-4198-9081-86e6ec627461 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:17.573474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 92/184] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:17 2022] GET /identity/v3/users/e0ec3a4302fe44adb3a39c786883fe00 => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:17.579667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711ed41-6f8b-4b2e-8cd7-06408b145f57 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:17.589219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711ed41-6f8b-4b2e-8cd7-06408b145f57 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:17.594116 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d4fbc-a0fa-40dd-b0f7-170499009ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:17.594792 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d4fbc-a0fa-40dd-b0f7-170499009ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:17.595072 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d4fbc-a0fa-40dd-b0f7-170499009ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:17.595343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d4fbc-a0fa-40dd-b0f7-170499009ffd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:17.603295 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d4fbc-a0fa-40dd-b0f7-170499009ffd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:17.605042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d4fbc-a0fa-40dd-b0f7-170499009ffd admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:17.614847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 93/185] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:17.620328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972047b9-0c5c-4198-9081-86e6ec627461 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:17.630849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972047b9-0c5c-4198-9081-86e6ec627461 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:17.635235 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7f60d-244f-449a-a1a1-a65d374ce01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:17.636072 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7f60d-244f-449a-a1a1-a65d374ce01d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:17.636351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7f60d-244f-449a-a1a1-a65d374ce01d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:17.636620 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7f60d-244f-449a-a1a1-a65d374ce01d admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:17.637783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7f60d-244f-449a-a1a1-a65d374ce01d admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:17.639856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7f60d-244f-449a-a1a1-a65d374ce01d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:17.642302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 93/186] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:17 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:17.648057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d4fbc-a0fa-40dd-b0f7-170499009ffd admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:17.657496 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d4fbc-a0fa-40dd-b0f7-170499009ffd admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:17.662621 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dcf39-8bc6-4a1c-b291-3dbe1c770a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:17.663271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dcf39-8bc6-4a1c-b291-3dbe1c770a08 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:17.663548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dcf39-8bc6-4a1c-b291-3dbe1c770a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:17.663820 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dcf39-8bc6-4a1c-b291-3dbe1c770a08 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:17.664645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dcf39-8bc6-4a1c-b291-3dbe1c770a08 admin admin] RBAC: Adding query filter params (role.id=093e9332cf3845ada22785bdc1b21626, scope.project.id=3c4f1a5a685848d5bd703ae910481be2, user.id=e0ec3a4302fe44adb3a39c786883fe00) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:17.664951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dcf39-8bc6-4a1c-b291-3dbe1c770a08 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:17.666980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dcf39-8bc6-4a1c-b291-3dbe1c770a08 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:17.673360 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 94/187] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:17 2022] GET /identity/v3/role_assignments?user.id=e0ec3a4302fe44adb3a39c786883fe00&scope.project.id=3c4f1a5a685848d5bd703ae910481be2&role.id=093e9332cf3845ada22785bdc1b21626 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:18.203176 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5a112-f247-461b-90b3-38a987f9cf73 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.203540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5a112-f247-461b-90b3-38a987f9cf73 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.203741 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5a112-f247-461b-90b3-38a987f9cf73 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.205527 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 94/188] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:18.211101 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f5fd-d3eb-40a4-b8d2-9a75cea134c1 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.211461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f5fd-d3eb-40a4-b8d2-9a75cea134c1 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.211802 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f5fd-d3eb-40a4-b8d2-9a75cea134c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.229927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-a641f5fd-d3eb-40a4-b8d2-9a75cea134c1 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:18.231118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a641f5fd-d3eb-40a4-b8d2-9a75cea134c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:18.239390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 95/189] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:18.251944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1c1c-ca77-4624-9667-5d5c92348b21 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.252233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1c1c-ca77-4624-9667-5d5c92348b21 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.252510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1c1c-ca77-4624-9667-5d5c92348b21 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.254344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 95/190] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:18.259477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae333fb-dce6-4927-beaa-3ec141423f72 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.259766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae333fb-dce6-4927-beaa-3ec141423f72 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.260038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae333fb-dce6-4927-beaa-3ec141423f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.262466 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1c1c-ca77-4624-9667-5d5c92348b21 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.274722 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1c1c-ca77-4624-9667-5d5c92348b21 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.277745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-6ae333fb-dce6-4927-beaa-3ec141423f72 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:18.278939 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6ae333fb-dce6-4927-beaa-3ec141423f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:18.279036 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959714d-035b-4316-b1c8-eff8a0bb5507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.279749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959714d-035b-4316-b1c8-eff8a0bb5507 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.279991 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959714d-035b-4316-b1c8-eff8a0bb5507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.280261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959714d-035b-4316-b1c8-eff8a0bb5507 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.287027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 96/191] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:18.291220 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959714d-035b-4316-b1c8-eff8a0bb5507 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:18.298071 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-3959714d-035b-4316-b1c8-eff8a0bb5507 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:25:18.299359 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 96/192] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:18.305141 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae333fb-dce6-4927-beaa-3ec141423f72 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.305562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294e15e-61cc-4985-8231-9ec8d35daaa8 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.305856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294e15e-61cc-4985-8231-9ec8d35daaa8 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.306133 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294e15e-61cc-4985-8231-9ec8d35daaa8 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.307892 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 97/193] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:18.312086 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294e15e-61cc-4985-8231-9ec8d35daaa8 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.314570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae333fb-dce6-4927-beaa-3ec141423f72 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.318782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a88b8-8df4-4023-bd1e-3461879bb89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.319429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a88b8-8df4-4023-bd1e-3461879bb89f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.319711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a88b8-8df4-4023-bd1e-3461879bb89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.319982 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a88b8-8df4-4023-bd1e-3461879bb89f admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.320727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a88b8-8df4-4023-bd1e-3461879bb89f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:18.321030 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a88b8-8df4-4023-bd1e-3461879bb89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:18.322662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a88b8-8df4-4023-bd1e-3461879bb89f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:18.323607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294e15e-61cc-4985-8231-9ec8d35daaa8 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.327684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373a9d1-3d25-4eed-99b0-bf942919fd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.328937 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373a9d1-3d25-4eed-99b0-bf942919fd94 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.329211 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373a9d1-3d25-4eed-99b0-bf942919fd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.329483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373a9d1-3d25-4eed-99b0-bf942919fd94 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.331359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 97/194] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:18.332489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279763c7-b4a4-437e-a5c9-59bd99688e9d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.332773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279763c7-b4a4-437e-a5c9-59bd99688e9d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.333045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279763c7-b4a4-437e-a5c9-59bd99688e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.343252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373a9d1-3d25-4eed-99b0-bf942919fd94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:18.350539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-279763c7-b4a4-437e-a5c9-59bd99688e9d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:18.351093 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-9373a9d1-3d25-4eed-99b0-bf942919fd94 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:18.351638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-279763c7-b4a4-437e-a5c9-59bd99688e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:18.352459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 98/195] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:18.352977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373a9d1-3d25-4eed-99b0-bf942919fd94 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.359573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 98/196] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:18.360172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279763c7-b4a4-437e-a5c9-59bd99688e9d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.362384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373a9d1-3d25-4eed-99b0-bf942919fd94 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.366543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a03ad-d682-41c8-ac2d-dc8e434fa146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.367327 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a03ad-d682-41c8-ac2d-dc8e434fa146 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.367602 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a03ad-d682-41c8-ac2d-dc8e434fa146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.367867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a03ad-d682-41c8-ac2d-dc8e434fa146 admin admin] PATH_INFO: `/v3/users/2a2a2a1ddeff4b779a9664d556eb2b3b` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.368984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279763c7-b4a4-437e-a5c9-59bd99688e9d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.375216 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d9c9a-47ed-419b-b7a8-5701041e408f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.375851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d9c9a-47ed-419b-b7a8-5701041e408f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.376133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d9c9a-47ed-419b-b7a8-5701041e408f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.376405 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d9c9a-47ed-419b-b7a8-5701041e408f admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.377152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d9c9a-47ed-419b-b7a8-5701041e408f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:18.377457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d9c9a-47ed-419b-b7a8-5701041e408f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:18.379092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d9c9a-47ed-419b-b7a8-5701041e408f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:18.383497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a03ad-d682-41c8-ac2d-dc8e434fa146 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a2a2a1ddeff4b779a9664d556eb2b3b)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:18.385733 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a03ad-d682-41c8-ac2d-dc8e434fa146 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:18.387447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 99/198] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/users/2a2a2a1ddeff4b779a9664d556eb2b3b => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:18.387548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 99/198] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:18.392348 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a03ad-d682-41c8-ac2d-dc8e434fa146 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.393348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d9c9a-47ed-419b-b7a8-5701041e408f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.397792 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a03ad-d682-41c8-ac2d-dc8e434fa146 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.401914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d22c5-eaf9-4621-a0ee-8882f75cf020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.402418 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d9c9a-47ed-419b-b7a8-5701041e408f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.402697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d22c5-eaf9-4621-a0ee-8882f75cf020 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.402983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d22c5-eaf9-4621-a0ee-8882f75cf020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.403252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d22c5-eaf9-4621-a0ee-8882f75cf020 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.404372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d22c5-eaf9-4621-a0ee-8882f75cf020 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:18.405990 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d22c5-eaf9-4621-a0ee-8882f75cf020 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:18.407393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487e32c-935c-455d-b301-c89a7f02ec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.408002 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487e32c-935c-455d-b301-c89a7f02ec75 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.408134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 100/199] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:18.408268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487e32c-935c-455d-b301-c89a7f02ec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.408538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487e32c-935c-455d-b301-c89a7f02ec75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.408831 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d22c5-eaf9-4621-a0ee-8882f75cf020 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.416325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487e32c-935c-455d-b301-c89a7f02ec75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:18.417516 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d22c5-eaf9-4621-a0ee-8882f75cf020 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.418037 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487e32c-935c-455d-b301-c89a7f02ec75 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:18.421673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c32556-9b8b-49f4-997e-54388be01e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.422509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c32556-9b8b-49f4-997e-54388be01e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.422791 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c32556-9b8b-49f4-997e-54388be01e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.423063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c32556-9b8b-49f4-997e-54388be01e48 admin admin] PATH_INFO: `/v3/users/2a2a2a1ddeff4b779a9664d556eb2b3b` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.424217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c32556-9b8b-49f4-997e-54388be01e48 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a2a2a1ddeff4b779a9664d556eb2b3b)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:18.426269 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c32556-9b8b-49f4-997e-54388be01e48 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:18.426509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 100/200] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:18.431240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487e32c-935c-455d-b301-c89a7f02ec75 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.431335 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 101/201] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/users/2a2a2a1ddeff4b779a9664d556eb2b3b => generated 283 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:18.435058 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c32556-9b8b-49f4-997e-54388be01e48 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.439139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487e32c-935c-455d-b301-c89a7f02ec75 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.443382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca995c7e-dc73-40d6-bc9a-31f83e9fd696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.443970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c32556-9b8b-49f4-997e-54388be01e48 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.444066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca995c7e-dc73-40d6-bc9a-31f83e9fd696 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.444265 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca995c7e-dc73-40d6-bc9a-31f83e9fd696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.444541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca995c7e-dc73-40d6-bc9a-31f83e9fd696 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.445241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca995c7e-dc73-40d6-bc9a-31f83e9fd696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:18.447152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca995c7e-dc73-40d6-bc9a-31f83e9fd696 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:18.448294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555f2e3-87dc-4850-8379-77fcea02213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.448899 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555f2e3-87dc-4850-8379-77fcea02213a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.449186 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555f2e3-87dc-4850-8379-77fcea02213a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.449465 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555f2e3-87dc-4850-8379-77fcea02213a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.458002 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555f2e3-87dc-4850-8379-77fcea02213a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:18.459894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555f2e3-87dc-4850-8379-77fcea02213a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:18.465730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 101/202] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:25:18 2022] POST /identity/v3/users => generated 297 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:18.469316 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 102/203] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:18.471220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca995c7e-dc73-40d6-bc9a-31f83e9fd696 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.475395 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555f2e3-87dc-4850-8379-77fcea02213a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.484819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca995c7e-dc73-40d6-bc9a-31f83e9fd696 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.485755 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555f2e3-87dc-4850-8379-77fcea02213a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.489330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be21b56-67ec-4111-ad07-cd07897affbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.490225 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be21b56-67ec-4111-ad07-cd07897affbe admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.490445 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5594ec8-1ebf-423b-84b4-254b03a49a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.490535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be21b56-67ec-4111-ad07-cd07897affbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.490800 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be21b56-67ec-4111-ad07-cd07897affbe admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.491114 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5594ec8-1ebf-423b-84b4-254b03a49a9c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.491395 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5594ec8-1ebf-423b-84b4-254b03a49a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.491657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5594ec8-1ebf-423b-84b4-254b03a49a9c admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.492055 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be21b56-67ec-4111-ad07-cd07897affbe admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:18.492942 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5594ec8-1ebf-423b-84b4-254b03a49a9c admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:18.494144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be21b56-67ec-4111-ad07-cd07897affbe admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:18.495057 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5594ec8-1ebf-423b-84b4-254b03a49a9c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:18.496184 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 102/204] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:18.496917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 103/205] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:18.502309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be21b56-67ec-4111-ad07-cd07897affbe admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.507140 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5594ec8-1ebf-423b-84b4-254b03a49a9c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:18.512378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be21b56-67ec-4111-ad07-cd07897affbe admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.517505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66e358-49df-4b38-8765-2b68f8c09d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.517651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5594ec8-1ebf-423b-84b4-254b03a49a9c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:18.518187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66e358-49df-4b38-8765-2b68f8c09d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.518499 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66e358-49df-4b38-8765-2b68f8c09d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.518774 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66e358-49df-4b38-8765-2b68f8c09d96 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.519622 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66e358-49df-4b38-8765-2b68f8c09d96 admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194, user.id=2a2a2a1ddeff4b779a9664d556eb2b3b) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:18.519936 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66e358-49df-4b38-8765-2b68f8c09d96 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:18.521807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66e358-49df-4b38-8765-2b68f8c09d96 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:18.522127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76830e-6136-45ad-a361-7fce56808055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:18.522838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76830e-6136-45ad-a361-7fce56808055 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:18.523122 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76830e-6136-45ad-a361-7fce56808055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:18.523395 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76830e-6136-45ad-a361-7fce56808055 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:18.524268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76830e-6136-45ad-a361-7fce56808055 admin admin] RBAC: Adding query filter params (role.id=289d1250826d4384990c8f3d403bc047, scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194, user.id=2a2a2a1ddeff4b779a9664d556eb2b3b) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:18.524564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76830e-6136-45ad-a361-7fce56808055 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:18.526510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76830e-6136-45ad-a361-7fce56808055 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:18.528184 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 103/206] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/role_assignments?user.id=2a2a2a1ddeff4b779a9664d556eb2b3b&scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194&role.id=548abad662724741a3261205ee7cb828 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:18.533502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 104/207] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:18 2022] GET /identity/v3/role_assignments?user.id=2a2a2a1ddeff4b779a9664d556eb2b3b&scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194&role.id=289d1250826d4384990c8f3d403bc047 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:20.860048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5214e4-d2bf-41fa-afb2-2ebab4dd242c None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:20.860553 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5214e4-d2bf-41fa-afb2-2ebab4dd242c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:20.860655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5214e4-d2bf-41fa-afb2-2ebab4dd242c None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:20.862628 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 104/208] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:20.867883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283ba2a-8363-4ba3-bdaa-ba9853290fa3 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:20.868304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283ba2a-8363-4ba3-bdaa-ba9853290fa3 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:20.868472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283ba2a-8363-4ba3-bdaa-ba9853290fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:20.877869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca85da-0d84-4674-b4f6-7eb2acb39689 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:20.878156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca85da-0d84-4674-b4f6-7eb2acb39689 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:20.878480 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca85da-0d84-4674-b4f6-7eb2acb39689 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:20.880367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 105/209] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:20.886372 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6747f3d-e201-4d0e-97cb-4714831c081f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:20.886660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6747f3d-e201-4d0e-97cb-4714831c081f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:20.886938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6747f3d-e201-4d0e-97cb-4714831c081f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:20.894524 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-3283ba2a-8363-4ba3-bdaa-ba9853290fa3 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:20.895716 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3283ba2a-8363-4ba3-bdaa-ba9853290fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:20.903442 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 105/210] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:20.907343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-b6747f3d-e201-4d0e-97cb-4714831c081f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:20.908728 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b6747f3d-e201-4d0e-97cb-4714831c081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:20.916571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 106/211] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:20.927382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283ba2a-8363-4ba3-bdaa-ba9853290fa3 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:20.936647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283ba2a-8363-4ba3-bdaa-ba9853290fa3 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:20.940558 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6747f3d-e201-4d0e-97cb-4714831c081f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:20.945020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16cc41-7288-479f-a98f-762522f39e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:20.946019 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16cc41-7288-479f-a98f-762522f39e7e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:20.946504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16cc41-7288-479f-a98f-762522f39e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:20.946776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16cc41-7288-479f-a98f-762522f39e7e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:20.950470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6747f3d-e201-4d0e-97cb-4714831c081f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:20.955833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623cfec-1b37-40c9-beb5-f614fbd2b183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:20.956638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623cfec-1b37-40c9-beb5-f614fbd2b183 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:20.957062 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623cfec-1b37-40c9-beb5-f614fbd2b183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:20.957210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623cfec-1b37-40c9-beb5-f614fbd2b183 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:20.958298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16cc41-7288-479f-a98f-762522f39e7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:20.965898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-da16cc41-7288-479f-a98f-762522f39e7e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:25:20.967404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 106/212] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:25:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:20.969145 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0ce5-a974-41a3-9cab-b91c167be3ab None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:20.969430 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0ce5-a974-41a3-9cab-b91c167be3ab None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:20.969699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0ce5-a974-41a3-9cab-b91c167be3ab None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:20.971545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 107/213] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:20.972123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623cfec-1b37-40c9-beb5-f614fbd2b183 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:20.974831 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0ce5-a974-41a3-9cab-b91c167be3ab None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:20.979988 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-9623cfec-1b37-40c9-beb5-f614fbd2b183 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:20.981196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 107/214] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:20.982508 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb011649-9ef0-4ed8-b96b-e5255e3fe278 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:20.982793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb011649-9ef0-4ed8-b96b-e5255e3fe278 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:20.983069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb011649-9ef0-4ed8-b96b-e5255e3fe278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:20.996273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0ce5-a974-41a3-9cab-b91c167be3ab None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.001855 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330f301-140d-44be-bb7d-a07b4e3b5752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.002364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-cb011649-9ef0-4ed8-b96b-e5255e3fe278 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:21.002545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330f301-140d-44be-bb7d-a07b4e3b5752 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.002828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330f301-140d-44be-bb7d-a07b4e3b5752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.003111 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330f301-140d-44be-bb7d-a07b4e3b5752 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.003536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-cb011649-9ef0-4ed8-b96b-e5255e3fe278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:21.003866 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330f301-140d-44be-bb7d-a07b4e3b5752 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:21.004170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330f301-140d-44be-bb7d-a07b4e3b5752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.005768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330f301-140d-44be-bb7d-a07b4e3b5752 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.010939 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 108/215] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:21.011785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb011649-9ef0-4ed8-b96b-e5255e3fe278 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.014843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 108/216] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:21.019345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff277c50-d783-4af7-8e46-f3afdf12bf95 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.019345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff277c50-d783-4af7-8e46-f3afdf12bf95 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.019345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff277c50-d783-4af7-8e46-f3afdf12bf95 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.019345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 109/217] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:21.020541 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff277c50-d783-4af7-8e46-f3afdf12bf95 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.023634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb011649-9ef0-4ed8-b96b-e5255e3fe278 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.027872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568699c-545a-456f-9c6d-d3fe36dac09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.028527 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568699c-545a-456f-9c6d-d3fe36dac09e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.029210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568699c-545a-456f-9c6d-d3fe36dac09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.029210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568699c-545a-456f-9c6d-d3fe36dac09e admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.029811 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568699c-545a-456f-9c6d-d3fe36dac09e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:21.030118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568699c-545a-456f-9c6d-d3fe36dac09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.032322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568699c-545a-456f-9c6d-d3fe36dac09e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.035265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff277c50-d783-4af7-8e46-f3afdf12bf95 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.039703 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a732a2-3312-4b61-a5f1-fdf4f4e409db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.040544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a732a2-3312-4b61-a5f1-fdf4f4e409db admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.040655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 109/218] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:21.040888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a732a2-3312-4b61-a5f1-fdf4f4e409db admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.041092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a732a2-3312-4b61-a5f1-fdf4f4e409db admin admin] PATH_INFO: `/v3/users/2a2a2a1ddeff4b779a9664d556eb2b3b` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.041786 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367040a8-bf78-42ce-987f-a1b911dfbe80 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.042073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367040a8-bf78-42ce-987f-a1b911dfbe80 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.042871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a732a2-3312-4b61-a5f1-fdf4f4e409db admin admin] RBAC: Authorizing `identity:get_user(user_id=2a2a2a1ddeff4b779a9664d556eb2b3b)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.042990 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367040a8-bf78-42ce-987f-a1b911dfbe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.044553 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a732a2-3312-4b61-a5f1-fdf4f4e409db admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.046183 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 110/219] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:21 2022] GET /identity/v3/users/2a2a2a1ddeff4b779a9664d556eb2b3b => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:21.048455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a732a2-3312-4b61-a5f1-fdf4f4e409db admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.058124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a732a2-3312-4b61-a5f1-fdf4f4e409db admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.061786 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-367040a8-bf78-42ce-987f-a1b911dfbe80 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:21.063309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-367040a8-bf78-42ce-987f-a1b911dfbe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:21.063476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70436b-594d-487f-b1db-75dc29854897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.064078 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70436b-594d-487f-b1db-75dc29854897 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.064353 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70436b-594d-487f-b1db-75dc29854897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.064673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70436b-594d-487f-b1db-75dc29854897 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.066183 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70436b-594d-487f-b1db-75dc29854897 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.067883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70436b-594d-487f-b1db-75dc29854897 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.070919 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 111/220] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:21.071569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 110/221] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:21.071849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70436b-594d-487f-b1db-75dc29854897 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.073563 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367040a8-bf78-42ce-987f-a1b911dfbe80 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.083759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367040a8-bf78-42ce-987f-a1b911dfbe80 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.085342 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70436b-594d-487f-b1db-75dc29854897 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.090824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46191086-8e7c-46ae-bf32-5a0c07524d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.091586 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191086-8e7c-46ae-bf32-5a0c07524d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.091869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191086-8e7c-46ae-bf32-5a0c07524d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.092387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191086-8e7c-46ae-bf32-5a0c07524d29 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.093398 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46191086-8e7c-46ae-bf32-5a0c07524d29 admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.094504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418aaa1-3c32-440f-87b7-27e7a81bc603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.095367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418aaa1-3c32-440f-87b7-27e7a81bc603 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.095646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418aaa1-3c32-440f-87b7-27e7a81bc603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.095914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418aaa1-3c32-440f-87b7-27e7a81bc603 admin admin] PATH_INFO: `/v3/users/2a2a2a1ddeff4b779a9664d556eb2b3b` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.096013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46191086-8e7c-46ae-bf32-5a0c07524d29 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.097102 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418aaa1-3c32-440f-87b7-27e7a81bc603 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a2a2a1ddeff4b779a9664d556eb2b3b)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.097695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 111/222] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:21 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:21.099208 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46191086-8e7c-46ae-bf32-5a0c07524d29 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.099314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418aaa1-3c32-440f-87b7-27e7a81bc603 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.100960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 112/223] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:21 2022] GET /identity/v3/users/2a2a2a1ddeff4b779a9664d556eb2b3b => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:21.101547 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418aaa1-3c32-440f-87b7-27e7a81bc603 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.110829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46191086-8e7c-46ae-bf32-5a0c07524d29 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.114654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418aaa1-3c32-440f-87b7-27e7a81bc603 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.115001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b197f-af1d-453d-8226-78c2011aa949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.115646 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b197f-af1d-453d-8226-78c2011aa949 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.115928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b197f-af1d-453d-8226-78c2011aa949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.116201 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b197f-af1d-453d-8226-78c2011aa949 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.116899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b197f-af1d-453d-8226-78c2011aa949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.118833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b197f-af1d-453d-8226-78c2011aa949 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.119004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c307e-81ed-41a9-987a-d98d7983a3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.119588 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c307e-81ed-41a9-987a-d98d7983a3fb admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.119868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c307e-81ed-41a9-987a-d98d7983a3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.120142 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c307e-81ed-41a9-987a-d98d7983a3fb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.130776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c307e-81ed-41a9-987a-d98d7983a3fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:21.137804 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-589c307e-81ed-41a9-987a-d98d7983a3fb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:21.138046 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 112/224] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:25:21 2022] POST /identity/v3/users => generated 297 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:21.145959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b197f-af1d-453d-8226-78c2011aa949 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.146093 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 113/225] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:21.146093 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c307e-81ed-41a9-987a-d98d7983a3fb admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.150397 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c307e-81ed-41a9-987a-d98d7983a3fb admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.155188 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374d801-d2f2-4fb8-8ab4-2a43eef71028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.156648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374d801-d2f2-4fb8-8ab4-2a43eef71028 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.156773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b197f-af1d-453d-8226-78c2011aa949 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.156944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374d801-d2f2-4fb8-8ab4-2a43eef71028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.157202 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374d801-d2f2-4fb8-8ab4-2a43eef71028 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.158568 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374d801-d2f2-4fb8-8ab4-2a43eef71028 admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.160732 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374d801-d2f2-4fb8-8ab4-2a43eef71028 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.161246 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783632a-9529-49f0-8bef-010669fdc873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.162157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783632a-9529-49f0-8bef-010669fdc873 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.162460 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783632a-9529-49f0-8bef-010669fdc873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.162733 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783632a-9529-49f0-8bef-010669fdc873 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194/users/2a2a2a1ddeff4b779a9664d556eb2b3b/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.162905 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 114/226] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:21 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:21.163703 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374d801-d2f2-4fb8-8ab4-2a43eef71028 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.164879 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783632a-9529-49f0-8bef-010669fdc873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194, user_id=2a2a2a1ddeff4b779a9664d556eb2b3b, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.167694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783632a-9529-49f0-8bef-010669fdc873 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.174238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374d801-d2f2-4fb8-8ab4-2a43eef71028 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.180367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa132ee7-363b-4673-834b-71ccfb63a918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.181052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa132ee7-363b-4673-834b-71ccfb63a918 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.181387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa132ee7-363b-4673-834b-71ccfb63a918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.181670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa132ee7-363b-4673-834b-71ccfb63a918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.182475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa132ee7-363b-4673-834b-71ccfb63a918 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:21.182797 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa132ee7-363b-4673-834b-71ccfb63a918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.183194 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 113/227] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:21 2022] PUT /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194/users/2a2a2a1ddeff4b779a9664d556eb2b3b/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:21.183834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783632a-9529-49f0-8bef-010669fdc873 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.184604 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa132ee7-363b-4673-834b-71ccfb63a918 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.206324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 115/228] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:21.207673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa132ee7-363b-4673-834b-71ccfb63a918 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.226064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa132ee7-363b-4673-834b-71ccfb63a918 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.263036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783632a-9529-49f0-8bef-010669fdc873 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.268396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41500-bbb5-4cb4-8fdd-cf0c181e7b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.269294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41500-bbb5-4cb4-8fdd-cf0c181e7b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.269570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41500-bbb5-4cb4-8fdd-cf0c181e7b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.269838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41500-bbb5-4cb4-8fdd-cf0c181e7b90 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194/users/2a2a2a1ddeff4b779a9664d556eb2b3b/roles/289d1250826d4384990c8f3d403bc047` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.272286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e41500-bbb5-4cb4-8fdd-cf0c181e7b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194, user_id=2a2a2a1ddeff4b779a9664d556eb2b3b, role_id=289d1250826d4384990c8f3d403bc047)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.275123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e41500-bbb5-4cb4-8fdd-cf0c181e7b90 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.292284 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 114/229] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:21 2022] PUT /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194/users/2a2a2a1ddeff4b779a9664d556eb2b3b/roles/289d1250826d4384990c8f3d403bc047 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:21.310237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e183a1-a1d3-43a0-83ec-39e4a5dab9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.310237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e183a1-a1d3-43a0-83ec-39e4a5dab9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.310237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e183a1-a1d3-43a0-83ec-39e4a5dab9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.310237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e183a1-a1d3-43a0-83ec-39e4a5dab9b0 admin admin] PATH_INFO: `/v3/users/1507fa45aeac4503a9153ed6faa8139c` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.325938 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e183a1-a1d3-43a0-83ec-39e4a5dab9b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=1507fa45aeac4503a9153ed6faa8139c)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.328923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e183a1-a1d3-43a0-83ec-39e4a5dab9b0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.331215 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 116/230] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:21 2022] GET /identity/v3/users/1507fa45aeac4503a9153ed6faa8139c => generated 297 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:21.337451 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41500-bbb5-4cb4-8fdd-cf0c181e7b90 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.415969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41500-bbb5-4cb4-8fdd-cf0c181e7b90 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.422670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb00ce-be21-4a7d-a8b6-14727a5c76cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.423400 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb00ce-be21-4a7d-a8b6-14727a5c76cb admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.423684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb00ce-be21-4a7d-a8b6-14727a5c76cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.424015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb00ce-be21-4a7d-a8b6-14727a5c76cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.433541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb00ce-be21-4a7d-a8b6-14727a5c76cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.435906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb00ce-be21-4a7d-a8b6-14727a5c76cb admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.448696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 115/231] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:21.454645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e183a1-a1d3-43a0-83ec-39e4a5dab9b0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.464889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e183a1-a1d3-43a0-83ec-39e4a5dab9b0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.470471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0197770-b2ef-4d79-93c9-ef7279816383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.471456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0197770-b2ef-4d79-93c9-ef7279816383 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.471807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0197770-b2ef-4d79-93c9-ef7279816383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.472156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0197770-b2ef-4d79-93c9-ef7279816383 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.473502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0197770-b2ef-4d79-93c9-ef7279816383 admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.475722 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0197770-b2ef-4d79-93c9-ef7279816383 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.477768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 117/232] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:21 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:21.483824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb00ce-be21-4a7d-a8b6-14727a5c76cb admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:21.493309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb00ce-be21-4a7d-a8b6-14727a5c76cb admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:21.497773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420beff9-5c44-4e9f-8463-cee272f63a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:21.498456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420beff9-5c44-4e9f-8463-cee272f63a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:21.498742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420beff9-5c44-4e9f-8463-cee272f63a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:21.499016 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420beff9-5c44-4e9f-8463-cee272f63a8a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:21.500151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420beff9-5c44-4e9f-8463-cee272f63a8a admin admin] RBAC: Adding query filter params (role.id=3d85c07c87374b898492488d6e608a27, scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194, user.id=1507fa45aeac4503a9153ed6faa8139c) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:21.500561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420beff9-5c44-4e9f-8463-cee272f63a8a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:21.502412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420beff9-5c44-4e9f-8463-cee272f63a8a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:21.508794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 116/233] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:21 2022] GET /identity/v3/role_assignments?user.id=1507fa45aeac4503a9153ed6faa8139c&scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194&role.id=3d85c07c87374b898492488d6e608a27 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:24.148605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da516d10-3550-4277-bfda-ef9e509def7b None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.149101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da516d10-3550-4277-bfda-ef9e509def7b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.149173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da516d10-3550-4277-bfda-ef9e509def7b None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.150948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 118/234] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:24.153257 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cebfb-d9f3-47ac-8c63-5a4479cbdcf2 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.154053 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cebfb-d9f3-47ac-8c63-5a4479cbdcf2 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.154542 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cebfb-d9f3-47ac-8c63-5a4479cbdcf2 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.156657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bb6ed-a29b-4fc8-ae6b-aed8abd43bd9 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.157233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bb6ed-a29b-4fc8-ae6b-aed8abd43bd9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.157724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bb6ed-a29b-4fc8-ae6b-aed8abd43bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.161852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 117/235] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:24.167184 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57cbf-6f0e-4e4c-8d1b-c4567a3d97ec None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.167473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57cbf-6f0e-4e4c-8d1b-c4567a3d97ec None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.167751 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57cbf-6f0e-4e4c-8d1b-c4567a3d97ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.187279 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-507bb6ed-a29b-4fc8-ae6b-aed8abd43bd9 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:24.188805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-507bb6ed-a29b-4fc8-ae6b-aed8abd43bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:24.192178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-55a57cbf-6f0e-4e4c-8d1b-c4567a3d97ec None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:24.193307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-55a57cbf-6f0e-4e4c-8d1b-c4567a3d97ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:24.204122 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 119/236] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:24.206133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 118/237] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:24.229387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bb6ed-a29b-4fc8-ae6b-aed8abd43bd9 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.239611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bb6ed-a29b-4fc8-ae6b-aed8abd43bd9 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.242680 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57cbf-6f0e-4e4c-8d1b-c4567a3d97ec None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.244368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738bc21-d45f-4c96-8048-0271355d9d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.245157 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738bc21-d45f-4c96-8048-0271355d9d80 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.245435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738bc21-d45f-4c96-8048-0271355d9d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.245707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738bc21-d45f-4c96-8048-0271355d9d80 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.252261 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57cbf-6f0e-4e4c-8d1b-c4567a3d97ec None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.256488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738bc21-d45f-4c96-8048-0271355d9d80 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:24.263384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-e738bc21-d45f-4c96-8048-0271355d9d80 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:25:24.264751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 120/238] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:24.267824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238702e3-6c33-461c-84f9-7cb7116199aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.268647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238702e3-6c33-461c-84f9-7cb7116199aa admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.268925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238702e3-6c33-461c-84f9-7cb7116199aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.269196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238702e3-6c33-461c-84f9-7cb7116199aa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.270728 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738bc21-d45f-4c96-8048-0271355d9d80 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.283088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738bc21-d45f-4c96-8048-0271355d9d80 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.287600 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238702e3-6c33-461c-84f9-7cb7116199aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:24.287805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5056914-db5a-44cc-afbc-76bee3d1ef5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.288435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056914-db5a-44cc-afbc-76bee3d1ef5c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.288718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056914-db5a-44cc-afbc-76bee3d1ef5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.288993 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056914-db5a-44cc-afbc-76bee3d1ef5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.293528 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5056914-db5a-44cc-afbc-76bee3d1ef5c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:24.293528 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5056914-db5a-44cc-afbc-76bee3d1ef5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.293528 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5056914-db5a-44cc-afbc-76bee3d1ef5c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.301732 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-238702e3-6c33-461c-84f9-7cb7116199aa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:24.301854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 121/239] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:24.303356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 119/240] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:24.304515 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfaf9c-d63f-4ef6-a4b7-19c327e5d5ed None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.305030 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfaf9c-d63f-4ef6-a4b7-19c327e5d5ed None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.305510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfaf9c-d63f-4ef6-a4b7-19c327e5d5ed None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.307627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 122/241] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:24.307730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238702e3-6c33-461c-84f9-7cb7116199aa admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.312623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfaf9c-d63f-4ef6-a4b7-19c327e5d5ed None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.318492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238702e3-6c33-461c-84f9-7cb7116199aa admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.323024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e186b4-709a-4f10-93c7-07c50964701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.323948 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e186b4-709a-4f10-93c7-07c50964701d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.324154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e186b4-709a-4f10-93c7-07c50964701d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.324428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e186b4-709a-4f10-93c7-07c50964701d admin admin] PATH_INFO: `/v3/users/c6aebba271ff4dcbb1d81186782f3e55` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.329084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfaf9c-d63f-4ef6-a4b7-19c327e5d5ed None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.334011 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e66df-1baf-4a3e-9853-91e5f12973c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.335182 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e66df-1baf-4a3e-9853-91e5f12973c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.335658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e66df-1baf-4a3e-9853-91e5f12973c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.336273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e66df-1baf-4a3e-9853-91e5f12973c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.337244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e66df-1baf-4a3e-9853-91e5f12973c9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:24.337748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e66df-1baf-4a3e-9853-91e5f12973c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.340279 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e66df-1baf-4a3e-9853-91e5f12973c9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.340539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e186b4-709a-4f10-93c7-07c50964701d admin admin] RBAC: Authorizing `identity:get_user(user_id=c6aebba271ff4dcbb1d81186782f3e55)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.342748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e186b4-709a-4f10-93c7-07c50964701d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.345306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 120/242] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/users/c6aebba271ff4dcbb1d81186782f3e55 => generated 297 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:24.346761 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fd9d1-e6a1-4c06-868f-ee35315b80b7 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.347094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fd9d1-e6a1-4c06-868f-ee35315b80b7 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.347370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fd9d1-e6a1-4c06-868f-ee35315b80b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.351451 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 123/243] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:24.353024 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844362a8-1a52-4d10-bf33-e7ff02e0aa2f None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.353693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844362a8-1a52-4d10-bf33-e7ff02e0aa2f None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.354161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844362a8-1a52-4d10-bf33-e7ff02e0aa2f None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.356938 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 124/244] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:24.357767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844362a8-1a52-4d10-bf33-e7ff02e0aa2f None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.365930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-578fd9d1-e6a1-4c06-868f-ee35315b80b7 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:24.367211 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-578fd9d1-e6a1-4c06-868f-ee35315b80b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:24.370264 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844362a8-1a52-4d10-bf33-e7ff02e0aa2f None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.374360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e162c6-8907-4a9d-983c-0ef996978c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.374572 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 121/245] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:24.375619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fd9d1-e6a1-4c06-868f-ee35315b80b7 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.378834 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e162c6-8907-4a9d-983c-0ef996978c7f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.379128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e162c6-8907-4a9d-983c-0ef996978c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.379403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e162c6-8907-4a9d-983c-0ef996978c7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.384520 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fd9d1-e6a1-4c06-868f-ee35315b80b7 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.387690 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e162c6-8907-4a9d-983c-0ef996978c7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.388988 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5da878-8800-4e3c-bc76-4bac51ffd313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.389537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e162c6-8907-4a9d-983c-0ef996978c7f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.390029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5da878-8800-4e3c-bc76-4bac51ffd313 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.390914 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5da878-8800-4e3c-bc76-4bac51ffd313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.391155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5da878-8800-4e3c-bc76-4bac51ffd313 admin admin] PATH_INFO: `/v3/users/2a2a2a1ddeff4b779a9664d556eb2b3b` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.392341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5da878-8800-4e3c-bc76-4bac51ffd313 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a2a2a1ddeff4b779a9664d556eb2b3b)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.394477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5da878-8800-4e3c-bc76-4bac51ffd313 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.396304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 122/246] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/users/2a2a2a1ddeff4b779a9664d556eb2b3b => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:24.399165 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 125/247] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:24.399379 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd2063-aa67-4db0-a056-efd43ddca069 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.399658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd2063-aa67-4db0-a056-efd43ddca069 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.399928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd2063-aa67-4db0-a056-efd43ddca069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.400284 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86a56-0834-4860-ba61-dd9f8d53550e None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.400571 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86a56-0834-4860-ba61-dd9f8d53550e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.400843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86a56-0834-4860-ba61-dd9f8d53550e None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.402652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 126/248] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:24.407684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e86a56-0834-4860-ba61-dd9f8d53550e None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.417776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-cdfd2063-aa67-4db0-a056-efd43ddca069 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:24.419041 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-cdfd2063-aa67-4db0-a056-efd43ddca069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:24.420815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e86a56-0834-4860-ba61-dd9f8d53550e None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.425001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad470b83-ca9a-41bf-b7dd-c13c4e5a5bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.425758 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad470b83-ca9a-41bf-b7dd-c13c4e5a5bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.426038 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad470b83-ca9a-41bf-b7dd-c13c4e5a5bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.426340 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad470b83-ca9a-41bf-b7dd-c13c4e5a5bb5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.426542 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 123/249] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:24.427290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd2063-aa67-4db0-a056-efd43ddca069 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.436249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd2063-aa67-4db0-a056-efd43ddca069 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.441256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad470b83-ca9a-41bf-b7dd-c13c4e5a5bb5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:24.442010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8d29d-f324-4162-b947-56e880a07fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.442674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d29d-f324-4162-b947-56e880a07fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.442956 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d29d-f324-4162-b947-56e880a07fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.443225 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d29d-f324-4162-b947-56e880a07fc4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.449939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-ad470b83-ca9a-41bf-b7dd-c13c4e5a5bb5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:24.452153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 127/250] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:24.453391 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8d29d-f324-4162-b947-56e880a07fc4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.453506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad470b83-ca9a-41bf-b7dd-c13c4e5a5bb5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.455188 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8d29d-f324-4162-b947-56e880a07fc4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.463293 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad470b83-ca9a-41bf-b7dd-c13c4e5a5bb5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.464146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 124/251] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:24.466000 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b077c-b07b-4def-bcd0-9895a8cbbc41 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.466329 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b077c-b07b-4def-bcd0-9895a8cbbc41 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.466632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b077c-b07b-4def-bcd0-9895a8cbbc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.467857 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3797f2c-1b3a-40f5-a038-f94b16257937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.469252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3797f2c-1b3a-40f5-a038-f94b16257937 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.469517 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3797f2c-1b3a-40f5-a038-f94b16257937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.469784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3797f2c-1b3a-40f5-a038-f94b16257937 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.470959 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3797f2c-1b3a-40f5-a038-f94b16257937 admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.472973 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3797f2c-1b3a-40f5-a038-f94b16257937 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.474634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 128/252] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:24.475352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3797f2c-1b3a-40f5-a038-f94b16257937 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.484590 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3797f2c-1b3a-40f5-a038-f94b16257937 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.484727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-dd4b077c-b07b-4def-bcd0-9895a8cbbc41 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:24.485923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-dd4b077c-b07b-4def-bcd0-9895a8cbbc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:24.488864 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4946e-6b08-4486-8bae-37338948641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.489595 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4946e-6b08-4486-8bae-37338948641e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.489875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4946e-6b08-4486-8bae-37338948641e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.490148 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4946e-6b08-4486-8bae-37338948641e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.491319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4946e-6b08-4486-8bae-37338948641e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.492950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4946e-6b08-4486-8bae-37338948641e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.493100 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 125/253] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:24.493834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b077c-b07b-4def-bcd0-9895a8cbbc41 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.499281 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 129/254] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:24.499281 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4946e-6b08-4486-8bae-37338948641e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.503081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b077c-b07b-4def-bcd0-9895a8cbbc41 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.507361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8510-742b-4c23-93e1-db80454fda89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.507986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8510-742b-4c23-93e1-db80454fda89 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.508261 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8510-742b-4c23-93e1-db80454fda89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.508528 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8510-742b-4c23-93e1-db80454fda89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.508620 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4946e-6b08-4486-8bae-37338948641e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.509262 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8510-742b-4c23-93e1-db80454fda89 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:24.509559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8510-742b-4c23-93e1-db80454fda89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.511145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8510-742b-4c23-93e1-db80454fda89 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.512751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860083-413d-427a-ad1d-3a1334233ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.513545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860083-413d-427a-ad1d-3a1334233ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.513825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860083-413d-427a-ad1d-3a1334233ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.514098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860083-413d-427a-ad1d-3a1334233ae9 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.515282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860083-413d-427a-ad1d-3a1334233ae9 admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.517966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860083-413d-427a-ad1d-3a1334233ae9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.519674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 130/255] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:24.519890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 126/256] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:24.520327 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860083-413d-427a-ad1d-3a1334233ae9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.520637 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8510-742b-4c23-93e1-db80454fda89 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.529741 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8510-742b-4c23-93e1-db80454fda89 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.529897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860083-413d-427a-ad1d-3a1334233ae9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.534496 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57578ed-83e7-46d1-88ae-06d156ad5c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.534759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c5aa8-1bff-4ddf-9a5e-21dd29a075e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.535132 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57578ed-83e7-46d1-88ae-06d156ad5c96 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.535364 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5aa8-1bff-4ddf-9a5e-21dd29a075e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.535453 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57578ed-83e7-46d1-88ae-06d156ad5c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.535644 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5aa8-1bff-4ddf-9a5e-21dd29a075e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.535729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57578ed-83e7-46d1-88ae-06d156ad5c96 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.535918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5aa8-1bff-4ddf-9a5e-21dd29a075e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.536342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57578ed-83e7-46d1-88ae-06d156ad5c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.536730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5aa8-1bff-4ddf-9a5e-21dd29a075e4 admin admin] RBAC: Adding query filter params (role.id=093e9332cf3845ada22785bdc1b21626, scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194, user.id=c6aebba271ff4dcbb1d81186782f3e55) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:24.537035 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5aa8-1bff-4ddf-9a5e-21dd29a075e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.538241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57578ed-83e7-46d1-88ae-06d156ad5c96 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.538857 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5aa8-1bff-4ddf-9a5e-21dd29a075e4 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.544240 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 131/257] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/role_assignments?user.id=c6aebba271ff4dcbb1d81186782f3e55&scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194&role.id=093e9332cf3845ada22785bdc1b21626 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:24.546037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c5aa8-1bff-4ddf-9a5e-21dd29a075e4 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.556170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c5aa8-1bff-4ddf-9a5e-21dd29a075e4 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.570724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 127/258] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:25:24 2022] POST /identity/v3/users => generated 293 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:24.570724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57578ed-83e7-46d1-88ae-06d156ad5c96 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.570724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57578ed-83e7-46d1-88ae-06d156ad5c96 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.574691 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1ad52-8944-4e4c-ae91-c43639c870d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.575139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897c7c4-473c-4243-bf5d-21a03c0613a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.575589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1ad52-8944-4e4c-ae91-c43639c870d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.575805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897c7c4-473c-4243-bf5d-21a03c0613a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.575970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1ad52-8944-4e4c-ae91-c43639c870d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.576114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897c7c4-473c-4243-bf5d-21a03c0613a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.576274 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1ad52-8944-4e4c-ae91-c43639c870d2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.576412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897c7c4-473c-4243-bf5d-21a03c0613a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.577190 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897c7c4-473c-4243-bf5d-21a03c0613a8 admin admin] RBAC: Adding query filter params (role.id=289d1250826d4384990c8f3d403bc047, scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194, user.id=2a2a2a1ddeff4b779a9664d556eb2b3b) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:24.577498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897c7c4-473c-4243-bf5d-21a03c0613a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.580321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897c7c4-473c-4243-bf5d-21a03c0613a8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.591588 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1ad52-8944-4e4c-ae91-c43639c870d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:24.598705 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 128/259] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/role_assignments?user.id=2a2a2a1ddeff4b779a9664d556eb2b3b&scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194&role.id=289d1250826d4384990c8f3d403bc047 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:24.599726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897c7c4-473c-4243-bf5d-21a03c0613a8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.599968 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-f2d1ad52-8944-4e4c-ae91-c43639c870d2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:25:24.601791 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 132/260] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:24.607922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1ad52-8944-4e4c-ae91-c43639c870d2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.617917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897c7c4-473c-4243-bf5d-21a03c0613a8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.625582 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1ad52-8944-4e4c-ae91-c43639c870d2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.632865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e03a5c-d05d-4b7a-854d-49a534b79e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.633795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e03a5c-d05d-4b7a-854d-49a534b79e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.634079 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e03a5c-d05d-4b7a-854d-49a534b79e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.634381 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e03a5c-d05d-4b7a-854d-49a534b79e88 admin admin] PATH_INFO: `/v3/users/1507fa45aeac4503a9153ed6faa8139c` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.636495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e03a5c-d05d-4b7a-854d-49a534b79e88 admin admin] RBAC: Authorizing `identity:get_user(user_id=1507fa45aeac4503a9153ed6faa8139c)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.638824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e03a5c-d05d-4b7a-854d-49a534b79e88 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.641723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 129/261] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/users/1507fa45aeac4503a9153ed6faa8139c => generated 297 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:24.642339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef96e8-87ba-4437-a3ab-f57ea58e7005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.643100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef96e8-87ba-4437-a3ab-f57ea58e7005 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.643303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef96e8-87ba-4437-a3ab-f57ea58e7005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.643572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef96e8-87ba-4437-a3ab-f57ea58e7005 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.644334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef96e8-87ba-4437-a3ab-f57ea58e7005 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:24.644634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef96e8-87ba-4437-a3ab-f57ea58e7005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.646321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef96e8-87ba-4437-a3ab-f57ea58e7005 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.648799 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e03a5c-d05d-4b7a-854d-49a534b79e88 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.664006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 133/262] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:24.666113 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e03a5c-d05d-4b7a-854d-49a534b79e88 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.670145 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef96e8-87ba-4437-a3ab-f57ea58e7005 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.679436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a184c-1434-4358-bd84-dedf610b5dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.680333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a184c-1434-4358-bd84-dedf610b5dba admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.680607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a184c-1434-4358-bd84-dedf610b5dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.680875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a184c-1434-4358-bd84-dedf610b5dba admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.682516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a184c-1434-4358-bd84-dedf610b5dba admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.684658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a184c-1434-4358-bd84-dedf610b5dba admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.686565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 130/263] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:24.689356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef96e8-87ba-4437-a3ab-f57ea58e7005 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.693616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a184c-1434-4358-bd84-dedf610b5dba admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.700480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81a801-8e99-456a-8d86-06216e037d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.701403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81a801-8e99-456a-8d86-06216e037d65 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.701678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81a801-8e99-456a-8d86-06216e037d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.701945 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81a801-8e99-456a-8d86-06216e037d65 admin admin] PATH_INFO: `/v3/users/2a2a2a1ddeff4b779a9664d556eb2b3b` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.705313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81a801-8e99-456a-8d86-06216e037d65 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a2a2a1ddeff4b779a9664d556eb2b3b)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.707812 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81a801-8e99-456a-8d86-06216e037d65 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.711428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 134/264] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/users/2a2a2a1ddeff4b779a9664d556eb2b3b => generated 283 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:24.713588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a184c-1434-4358-bd84-dedf610b5dba admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.717447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81a801-8e99-456a-8d86-06216e037d65 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.725675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4cd67-caa5-45e7-a555-d0137ed770aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.726630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4cd67-caa5-45e7-a555-d0137ed770aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.726907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4cd67-caa5-45e7-a555-d0137ed770aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.727225 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4cd67-caa5-45e7-a555-d0137ed770aa admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194/users/1507fa45aeac4503a9153ed6faa8139c/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.730835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4cd67-caa5-45e7-a555-d0137ed770aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194, user_id=1507fa45aeac4503a9153ed6faa8139c, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.733638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4cd67-caa5-45e7-a555-d0137ed770aa admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.738557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81a801-8e99-456a-8d86-06216e037d65 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.744713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a3c88-c299-45a5-a90a-e1a52fa16972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.745374 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3c88-c299-45a5-a90a-e1a52fa16972 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.745701 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3c88-c299-45a5-a90a-e1a52fa16972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.745974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3c88-c299-45a5-a90a-e1a52fa16972 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.756686 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a3c88-c299-45a5-a90a-e1a52fa16972 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.758593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a3c88-c299-45a5-a90a-e1a52fa16972 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.764563 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 131/265] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:24 2022] PUT /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194/users/1507fa45aeac4503a9153ed6faa8139c/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:24.770963 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 135/266] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:25:24.776566 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4cd67-caa5-45e7-a555-d0137ed770aa admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.858746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4cd67-caa5-45e7-a555-d0137ed770aa admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.863339 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a22c4-3166-4451-bb71-e57352c269ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.864148 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a22c4-3166-4451-bb71-e57352c269ca admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.864429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a22c4-3166-4451-bb71-e57352c269ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.864699 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a22c4-3166-4451-bb71-e57352c269ca admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.865864 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a22c4-3166-4451-bb71-e57352c269ca admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.868042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a22c4-3166-4451-bb71-e57352c269ca admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.870148 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 132/267] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:24.876545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a3c88-c299-45a5-a90a-e1a52fa16972 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:24.886234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a3c88-c299-45a5-a90a-e1a52fa16972 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:24.895847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079f34f-8b3a-4b61-bbb9-0cb6a204c3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:24.896575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079f34f-8b3a-4b61-bbb9-0cb6a204c3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:24.896846 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079f34f-8b3a-4b61-bbb9-0cb6a204c3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:24.897146 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079f34f-8b3a-4b61-bbb9-0cb6a204c3c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:24.897989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079f34f-8b3a-4b61-bbb9-0cb6a204c3c9 admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194, user.id=2a2a2a1ddeff4b779a9664d556eb2b3b) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:24.898393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079f34f-8b3a-4b61-bbb9-0cb6a204c3c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:24.900276 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079f34f-8b3a-4b61-bbb9-0cb6a204c3c9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:24.908458 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 136/268] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:24 2022] GET /identity/v3/role_assignments?user.id=2a2a2a1ddeff4b779a9664d556eb2b3b&scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194&role.id=548abad662724741a3261205ee7cb828 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:26.996888 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36db7ad-a406-4407-b1e7-76961a235b61 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:26.997436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36db7ad-a406-4407-b1e7-76961a235b61 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:26.997436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36db7ad-a406-4407-b1e7-76961a235b61 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:26.999393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 133/269] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:27.005286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773e3a-690c-4da9-a158-b0fc88c3fd69 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.006100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773e3a-690c-4da9-a158-b0fc88c3fd69 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.006608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773e3a-690c-4da9-a158-b0fc88c3fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.028409 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-99773e3a-690c-4da9-a158-b0fc88c3fd69 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:27.029914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-99773e3a-690c-4da9-a158-b0fc88c3fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:27.037897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 137/270] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:27.060589 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36db7ad-a406-4407-b1e7-76961a235b61 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.073650 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36db7ad-a406-4407-b1e7-76961a235b61 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.078840 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd824c4-f7cf-4030-aac0-72d385aaa485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.079853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd824c4-f7cf-4030-aac0-72d385aaa485 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.080355 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd824c4-f7cf-4030-aac0-72d385aaa485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.080836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd824c4-f7cf-4030-aac0-72d385aaa485 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.092276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd824c4-f7cf-4030-aac0-72d385aaa485 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:27.102011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-9fd824c4-f7cf-4030-aac0-72d385aaa485 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:25:27.102011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 134/271] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:27.107601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99773e3a-690c-4da9-a158-b0fc88c3fd69 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.116861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99773e3a-690c-4da9-a158-b0fc88c3fd69 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.121913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73627d8-02c0-4290-acd5-f571d38c64d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.122601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73627d8-02c0-4290-acd5-f571d38c64d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.122870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73627d8-02c0-4290-acd5-f571d38c64d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.123143 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73627d8-02c0-4290-acd5-f571d38c64d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.123896 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73627d8-02c0-4290-acd5-f571d38c64d9 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:27.124198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73627d8-02c0-4290-acd5-f571d38c64d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.126407 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73627d8-02c0-4290-acd5-f571d38c64d9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.136346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 138/272] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:27.144149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd824c4-f7cf-4030-aac0-72d385aaa485 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.154888 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd824c4-f7cf-4030-aac0-72d385aaa485 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.159816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afc3d5-6f84-4c8a-b95d-c6383537a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.161314 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afc3d5-6f84-4c8a-b95d-c6383537a9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.161592 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afc3d5-6f84-4c8a-b95d-c6383537a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.162308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afc3d5-6f84-4c8a-b95d-c6383537a9dd admin admin] PATH_INFO: `/v3/users/c6aebba271ff4dcbb1d81186782f3e55` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.163517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afc3d5-6f84-4c8a-b95d-c6383537a9dd admin admin] RBAC: Authorizing `identity:get_user(user_id=c6aebba271ff4dcbb1d81186782f3e55)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.165648 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afc3d5-6f84-4c8a-b95d-c6383537a9dd admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.168300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 135/273] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/users/c6aebba271ff4dcbb1d81186782f3e55 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:27.174401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73627d8-02c0-4290-acd5-f571d38c64d9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.185158 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73627d8-02c0-4290-acd5-f571d38c64d9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.190075 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783661f-076c-49f1-8864-9f53e537a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.191843 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e302299-82ff-4561-a699-07741b2ed3a3 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.192122 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e302299-82ff-4561-a699-07741b2ed3a3 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.192397 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e302299-82ff-4561-a699-07741b2ed3a3 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.192703 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783661f-076c-49f1-8864-9f53e537a5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.192988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783661f-076c-49f1-8864-9f53e537a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.193259 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783661f-076c-49f1-8864-9f53e537a5b1 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.194144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 136/274] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:27.194918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783661f-076c-49f1-8864-9f53e537a5b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.197128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783661f-076c-49f1-8864-9f53e537a5b1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.199120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52098ec3-f170-4e41-8d67-9b2f94bcaf20 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.199312 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 139/275] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:27.199424 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52098ec3-f170-4e41-8d67-9b2f94bcaf20 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.199656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52098ec3-f170-4e41-8d67-9b2f94bcaf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.205206 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783661f-076c-49f1-8864-9f53e537a5b1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.214787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783661f-076c-49f1-8864-9f53e537a5b1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.219289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d5d0f-c2a0-4efa-ba78-e464545c41f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.219882 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-52098ec3-f170-4e41-8d67-9b2f94bcaf20 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:27.220313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d5d0f-c2a0-4efa-ba78-e464545c41f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.220663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d5d0f-c2a0-4efa-ba78-e464545c41f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.220999 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d5d0f-c2a0-4efa-ba78-e464545c41f0 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194/users/c6aebba271ff4dcbb1d81186782f3e55/roles/093e9332cf3845ada22785bdc1b21626` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.221149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-52098ec3-f170-4e41-8d67-9b2f94bcaf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:27.223131 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d5d0f-c2a0-4efa-ba78-e464545c41f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194, user_id=c6aebba271ff4dcbb1d81186782f3e55, role_id=093e9332cf3845ada22785bdc1b21626)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.225821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d5d0f-c2a0-4efa-ba78-e464545c41f0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.229984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 137/276] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:27.242111 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 140/277] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:27 2022] PUT /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194/users/c6aebba271ff4dcbb1d81186782f3e55/roles/093e9332cf3845ada22785bdc1b21626 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:25:27.255727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52098ec3-f170-4e41-8d67-9b2f94bcaf20 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.261918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e665844-f768-434a-a334-1a94054ad3cf None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.262225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e665844-f768-434a-a334-1a94054ad3cf None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.262523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e665844-f768-434a-a334-1a94054ad3cf None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.264361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 141/278] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:27.266580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52098ec3-f170-4e41-8d67-9b2f94bcaf20 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.270368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c084bdc-e3d8-4ad5-8dff-3521730b0880 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.270655 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c084bdc-e3d8-4ad5-8dff-3521730b0880 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.270936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c084bdc-e3d8-4ad5-8dff-3521730b0880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.289328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-7c084bdc-e3d8-4ad5-8dff-3521730b0880 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:27.290652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7c084bdc-e3d8-4ad5-8dff-3521730b0880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:27.332562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66491f-3990-4a17-a4fb-8afd6278c399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.334363 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66491f-3990-4a17-a4fb-8afd6278c399 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.334874 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66491f-3990-4a17-a4fb-8afd6278c399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.335149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66491f-3990-4a17-a4fb-8afd6278c399 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.346518 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66491f-3990-4a17-a4fb-8afd6278c399 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:27.353618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-6d66491f-3990-4a17-a4fb-8afd6278c399 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:27.354904 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 138/279] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:27.357158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746a7ca-8ae8-4373-8b1b-5f06cda9476b None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.357876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746a7ca-8ae8-4373-8b1b-5f06cda9476b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.358321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746a7ca-8ae8-4373-8b1b-5f06cda9476b None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.361296 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 139/280] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:27.362054 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746a7ca-8ae8-4373-8b1b-5f06cda9476b None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.374101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 142/281] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:27.376668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eae0b4-a022-4572-af95-a960dba57a12 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.376957 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eae0b4-a022-4572-af95-a960dba57a12 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.377231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eae0b4-a022-4572-af95-a960dba57a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.378459 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746a7ca-8ae8-4373-8b1b-5f06cda9476b None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.383912 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54596149-ab0a-47c4-99fb-0908c1a17e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.385846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54596149-ab0a-47c4-99fb-0908c1a17e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.386360 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54596149-ab0a-47c4-99fb-0908c1a17e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.386821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54596149-ab0a-47c4-99fb-0908c1a17e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.387804 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54596149-ab0a-47c4-99fb-0908c1a17e8d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:27.388292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54596149-ab0a-47c4-99fb-0908c1a17e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.390693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54596149-ab0a-47c4-99fb-0908c1a17e8d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.398464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-54eae0b4-a022-4572-af95-a960dba57a12 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:27.399676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-54eae0b4-a022-4572-af95-a960dba57a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:27.402788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 140/282] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:27.403396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54596149-ab0a-47c4-99fb-0908c1a17e8d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.408237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 143/283] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:27.409327 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eae0b4-a022-4572-af95-a960dba57a12 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.416083 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54596149-ab0a-47c4-99fb-0908c1a17e8d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.419080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eae0b4-a022-4572-af95-a960dba57a12 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.421108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc743793-49f6-4da6-8ea2-11aa7013402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.422657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc743793-49f6-4da6-8ea2-11aa7013402b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.423101 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc743793-49f6-4da6-8ea2-11aa7013402b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.423445 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc743793-49f6-4da6-8ea2-11aa7013402b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.425675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b8398-8f4f-4717-8718-a16108d145c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.427357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b8398-8f4f-4717-8718-a16108d145c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.427830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b8398-8f4f-4717-8718-a16108d145c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.428271 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b8398-8f4f-4717-8718-a16108d145c7 admin admin] PATH_INFO: `/v3/users/1507fa45aeac4503a9153ed6faa8139c` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.429654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b8398-8f4f-4717-8718-a16108d145c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=1507fa45aeac4503a9153ed6faa8139c)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.432011 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b8398-8f4f-4717-8718-a16108d145c7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.434094 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 144/284] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/users/1507fa45aeac4503a9153ed6faa8139c => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:27.435055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b8398-8f4f-4717-8718-a16108d145c7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.436674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc743793-49f6-4da6-8ea2-11aa7013402b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:27.444332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-cc743793-49f6-4da6-8ea2-11aa7013402b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:27.445618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 141/285] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:27.446458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc743793-49f6-4da6-8ea2-11aa7013402b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.449950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b8398-8f4f-4717-8718-a16108d145c7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.454712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd031fd-e365-4647-ba1b-a211eb770e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.455557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd031fd-e365-4647-ba1b-a211eb770e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.455884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd031fd-e365-4647-ba1b-a211eb770e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.456159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd031fd-e365-4647-ba1b-a211eb770e8c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.457066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc743793-49f6-4da6-8ea2-11aa7013402b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.457483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd031fd-e365-4647-ba1b-a211eb770e8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.459207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd031fd-e365-4647-ba1b-a211eb770e8c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.460802 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 145/286] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:27.461541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15920f-3c2c-46d2-8802-aee35de6efea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.461666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd031fd-e365-4647-ba1b-a211eb770e8c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.462270 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15920f-3c2c-46d2-8802-aee35de6efea admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.462606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15920f-3c2c-46d2-8802-aee35de6efea admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.462863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15920f-3c2c-46d2-8802-aee35de6efea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.472530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd031fd-e365-4647-ba1b-a211eb770e8c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.472967 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15920f-3c2c-46d2-8802-aee35de6efea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.474801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15920f-3c2c-46d2-8802-aee35de6efea admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.476904 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb34a7-c823-43e8-96f1-6e3d0d994ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.477555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb34a7-c823-43e8-96f1-6e3d0d994ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.477837 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb34a7-c823-43e8-96f1-6e3d0d994ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.478110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb34a7-c823-43e8-96f1-6e3d0d994ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.478917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb34a7-c823-43e8-96f1-6e3d0d994ae8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:27.479213 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb34a7-c823-43e8-96f1-6e3d0d994ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.480894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb34a7-c823-43e8-96f1-6e3d0d994ae8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.485448 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 142/287] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:27.486075 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15920f-3c2c-46d2-8802-aee35de6efea admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.493849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 146/288] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:27.494801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15920f-3c2c-46d2-8802-aee35de6efea admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.495180 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb34a7-c823-43e8-96f1-6e3d0d994ae8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.499243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece64894-ba9f-4968-ace5-5fff64066d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.500742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64894-ba9f-4968-ace5-5fff64066d8e admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.501029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64894-ba9f-4968-ace5-5fff64066d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.501304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64894-ba9f-4968-ace5-5fff64066d8e admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.502008 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece64894-ba9f-4968-ace5-5fff64066d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.503951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece64894-ba9f-4968-ace5-5fff64066d8e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.506466 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb34a7-c823-43e8-96f1-6e3d0d994ae8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.510634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c12c7-0f22-4c77-a87e-3e679a3d26dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.511756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c12c7-0f22-4c77-a87e-3e679a3d26dd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.511756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c12c7-0f22-4c77-a87e-3e679a3d26dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.511913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c12c7-0f22-4c77-a87e-3e679a3d26dd admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.513479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c12c7-0f22-4c77-a87e-3e679a3d26dd admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.515373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c12c7-0f22-4c77-a87e-3e679a3d26dd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.522122 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 147/289] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:27.522122 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c12c7-0f22-4c77-a87e-3e679a3d26dd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.525593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 143/290] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:25:27 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:27.526437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece64894-ba9f-4968-ace5-5fff64066d8e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.531815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c12c7-0f22-4c77-a87e-3e679a3d26dd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.537453 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15720cc1-749c-4b87-b85f-2a37f7585099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.537679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece64894-ba9f-4968-ace5-5fff64066d8e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.538365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15720cc1-749c-4b87-b85f-2a37f7585099 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.538644 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15720cc1-749c-4b87-b85f-2a37f7585099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.538911 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15720cc1-749c-4b87-b85f-2a37f7585099 admin admin] PATH_INFO: `/v3/users/c5e9534f03564c78acf854ad48e19a11` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.543537 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bb900-ce01-46fd-b549-c6ddd88ae2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.544223 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bb900-ce01-46fd-b549-c6ddd88ae2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.544507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bb900-ce01-46fd-b549-c6ddd88ae2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.544789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bb900-ce01-46fd-b549-c6ddd88ae2ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.545648 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bb900-ce01-46fd-b549-c6ddd88ae2ce admin admin] RBAC: Adding query filter params (role.id=3d85c07c87374b898492488d6e608a27, scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194, user.id=1507fa45aeac4503a9153ed6faa8139c) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:27.545969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bb900-ce01-46fd-b549-c6ddd88ae2ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.548486 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bb900-ce01-46fd-b549-c6ddd88ae2ce admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.556854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15720cc1-749c-4b87-b85f-2a37f7585099 admin admin] RBAC: Authorizing `identity:get_user(user_id=c5e9534f03564c78acf854ad48e19a11)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.557251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 144/291] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/role_assignments?user.id=1507fa45aeac4503a9153ed6faa8139c&scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194&role.id=3d85c07c87374b898492488d6e608a27 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:27.559088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15720cc1-749c-4b87-b85f-2a37f7585099 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.561233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 148/292] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/users/c5e9534f03564c78acf854ad48e19a11 => generated 293 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:27.568061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bb900-ce01-46fd-b549-c6ddd88ae2ce admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:27.588516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bb900-ce01-46fd-b549-c6ddd88ae2ce admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:27.593714 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20901df-1407-4d71-b1d6-8be173282b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:27.594487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20901df-1407-4d71-b1d6-8be173282b52 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:27.594821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20901df-1407-4d71-b1d6-8be173282b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:27.595106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20901df-1407-4d71-b1d6-8be173282b52 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:27.596082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20901df-1407-4d71-b1d6-8be173282b52 admin admin] RBAC: Adding query filter params (role.id=3d85c07c87374b898492488d6e608a27, user.id=c5e9534f03564c78acf854ad48e19a11, scope.system=all) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:27.596404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20901df-1407-4d71-b1d6-8be173282b52 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:27.598654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20901df-1407-4d71-b1d6-8be173282b52 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:27.609497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 145/293] 10.222.0.79 () {56 vars in 1329 bytes} [Mon Feb 21 01:25:27 2022] GET /identity/v3/role_assignments?user.id=c5e9534f03564c78acf854ad48e19a11&scope.system=all&role.id=3d85c07c87374b898492488d6e608a27 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:29.656019 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0e360-f36a-4545-8da1-fad689f5bc08 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:29.656550 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0e360-f36a-4545-8da1-fad689f5bc08 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:29.656550 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0e360-f36a-4545-8da1-fad689f5bc08 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:29.658448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 149/294] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:29.664426 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce5b35-1719-4246-9881-06bddf236177 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:29.664933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce5b35-1719-4246-9881-06bddf236177 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:29.665031 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce5b35-1719-4246-9881-06bddf236177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:29.684510 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-14ce5b35-1719-4246-9881-06bddf236177 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:29.685685 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-14ce5b35-1719-4246-9881-06bddf236177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:29.693945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 146/295] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:29.717734 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0e360-f36a-4545-8da1-fad689f5bc08 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:29.730238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0e360-f36a-4545-8da1-fad689f5bc08 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:29.735240 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d340482-5ace-4ff3-8fd0-6a705d4ac414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:29.736021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d340482-5ace-4ff3-8fd0-6a705d4ac414 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:29.736300 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d340482-5ace-4ff3-8fd0-6a705d4ac414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:29.736567 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d340482-5ace-4ff3-8fd0-6a705d4ac414 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:29.746947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d340482-5ace-4ff3-8fd0-6a705d4ac414 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:29.754629 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-2d340482-5ace-4ff3-8fd0-6a705d4ac414 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:25:29.755821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 150/296] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:29.761496 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce5b35-1719-4246-9881-06bddf236177 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:29.770597 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce5b35-1719-4246-9881-06bddf236177 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:29.774996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6c255-eab7-4c51-b05e-b41300f7a377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:29.775669 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6c255-eab7-4c51-b05e-b41300f7a377 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:29.775952 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6c255-eab7-4c51-b05e-b41300f7a377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:29.776228 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6c255-eab7-4c51-b05e-b41300f7a377 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:29.776978 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6c255-eab7-4c51-b05e-b41300f7a377 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:29.777285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6c255-eab7-4c51-b05e-b41300f7a377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:29.778926 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6c255-eab7-4c51-b05e-b41300f7a377 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:29.787774 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 147/297] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:29.793071 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d340482-5ace-4ff3-8fd0-6a705d4ac414 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:29.803415 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d340482-5ace-4ff3-8fd0-6a705d4ac414 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:29.807773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce2518-d4f0-4b01-bc9f-148dc03e3ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:29.808692 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce2518-d4f0-4b01-bc9f-148dc03e3ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:29.808975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce2518-d4f0-4b01-bc9f-148dc03e3ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:29.809239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce2518-d4f0-4b01-bc9f-148dc03e3ee1 admin admin] PATH_INFO: `/v3/users/c6aebba271ff4dcbb1d81186782f3e55` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:29.810503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce2518-d4f0-4b01-bc9f-148dc03e3ee1 admin admin] RBAC: Authorizing `identity:get_user(user_id=c6aebba271ff4dcbb1d81186782f3e55)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:29.813198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce2518-d4f0-4b01-bc9f-148dc03e3ee1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:29.814835 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 151/298] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:29 2022] GET /identity/v3/users/c6aebba271ff4dcbb1d81186782f3e55 => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:29.820375 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6c255-eab7-4c51-b05e-b41300f7a377 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:29.830924 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6c255-eab7-4c51-b05e-b41300f7a377 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:29.835498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ee564-edf7-47d5-b5ac-bbb6f650c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:29.836166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ee564-edf7-47d5-b5ac-bbb6f650c307 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:29.836512 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ee564-edf7-47d5-b5ac-bbb6f650c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:29.836790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ee564-edf7-47d5-b5ac-bbb6f650c307 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:29.846024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ee564-edf7-47d5-b5ac-bbb6f650c307 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:29.847963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ee564-edf7-47d5-b5ac-bbb6f650c307 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:29.858337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 148/299] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:29.864625 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce2518-d4f0-4b01-bc9f-148dc03e3ee1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:29.876296 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce2518-d4f0-4b01-bc9f-148dc03e3ee1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:29.880790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17051f-c14a-475f-a779-a5646cb72fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:29.881758 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17051f-c14a-475f-a779-a5646cb72fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:29.882046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17051f-c14a-475f-a779-a5646cb72fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:29.882347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17051f-c14a-475f-a779-a5646cb72fb1 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:29.883535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17051f-c14a-475f-a779-a5646cb72fb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:29.885649 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17051f-c14a-475f-a779-a5646cb72fb1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:29.887423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 152/300] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:29 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:29.893433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ee564-edf7-47d5-b5ac-bbb6f650c307 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:29.902582 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ee564-edf7-47d5-b5ac-bbb6f650c307 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:29.907603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4b16-3d6e-44ec-8d90-05bac4b444ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:29.908242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4b16-3d6e-44ec-8d90-05bac4b444ce admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:29.908531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4b16-3d6e-44ec-8d90-05bac4b444ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:29.908805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4b16-3d6e-44ec-8d90-05bac4b444ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:29.909634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4b16-3d6e-44ec-8d90-05bac4b444ce admin admin] RBAC: Adding query filter params (role.id=093e9332cf3845ada22785bdc1b21626, scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194, user.id=c6aebba271ff4dcbb1d81186782f3e55) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:29.909944 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4b16-3d6e-44ec-8d90-05bac4b444ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:29.911868 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4b16-3d6e-44ec-8d90-05bac4b444ce admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:29.918019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 149/301] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:29 2022] GET /identity/v3/role_assignments?user.id=c6aebba271ff4dcbb1d81186782f3e55&scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194&role.id=093e9332cf3845ada22785bdc1b21626 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:30.042258 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c86f9f-4e1f-46c7-b6c4-7774e0f78d9c None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.042582 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c86f9f-4e1f-46c7-b6c4-7774e0f78d9c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.042816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c86f9f-4e1f-46c7-b6c4-7774e0f78d9c None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.044914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 153/302] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:30.052641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3565-fa97-4095-a541-5c1267b0a528 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.053071 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3565-fa97-4095-a541-5c1267b0a528 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.053453 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3565-fa97-4095-a541-5c1267b0a528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.072557 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-d22a3565-fa97-4095-a541-5c1267b0a528 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:30.073755 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d22a3565-fa97-4095-a541-5c1267b0a528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:30.081951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 150/303] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:30.106006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c86f9f-4e1f-46c7-b6c4-7774e0f78d9c None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:30.118973 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c86f9f-4e1f-46c7-b6c4-7774e0f78d9c None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:30.126887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a13587-2d8b-4fa1-9529-610cca8e9033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:30.127699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a13587-2d8b-4fa1-9529-610cca8e9033 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.127980 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a13587-2d8b-4fa1-9529-610cca8e9033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.128254 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a13587-2d8b-4fa1-9529-610cca8e9033 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.140493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a13587-2d8b-4fa1-9529-610cca8e9033 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:30.147981 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-32a13587-2d8b-4fa1-9529-610cca8e9033 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:30.149721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 154/304] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:30.156708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a3565-fa97-4095-a541-5c1267b0a528 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:30.167980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a3565-fa97-4095-a541-5c1267b0a528 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:30.173892 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09457952-8b0c-4dc0-ac82-ef0c983b149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:30.174633 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09457952-8b0c-4dc0-ac82-ef0c983b149b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.174923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09457952-8b0c-4dc0-ac82-ef0c983b149b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.175202 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09457952-8b0c-4dc0-ac82-ef0c983b149b admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.175953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09457952-8b0c-4dc0-ac82-ef0c983b149b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:30.176263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09457952-8b0c-4dc0-ac82-ef0c983b149b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:30.177869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09457952-8b0c-4dc0-ac82-ef0c983b149b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:30.187147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 151/305] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:30.192737 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a13587-2d8b-4fa1-9529-610cca8e9033 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:30.203419 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a13587-2d8b-4fa1-9529-610cca8e9033 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:30.208083 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf81a4-3559-498c-8ba2-6772ae566479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:30.209225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf81a4-3559-498c-8ba2-6772ae566479 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.209835 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf81a4-3559-498c-8ba2-6772ae566479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.210426 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf81a4-3559-498c-8ba2-6772ae566479 admin admin] PATH_INFO: `/v3/users/c5e9534f03564c78acf854ad48e19a11` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.211828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf81a4-3559-498c-8ba2-6772ae566479 admin admin] RBAC: Authorizing `identity:get_user(user_id=c5e9534f03564c78acf854ad48e19a11)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:30.212085 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2e163-58d7-443c-8c00-79f97cf5a628 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.212377 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2e163-58d7-443c-8c00-79f97cf5a628 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.212654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2e163-58d7-443c-8c00-79f97cf5a628 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.214444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 152/306] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:30.214743 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf81a4-3559-498c-8ba2-6772ae566479 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:30.216599 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 155/307] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:30 2022] GET /identity/v3/users/c5e9534f03564c78acf854ad48e19a11 => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:30.220117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873ec44-7c6c-429f-9d3b-2cd7e9c30766 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.220403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873ec44-7c6c-429f-9d3b-2cd7e9c30766 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.220676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873ec44-7c6c-429f-9d3b-2cd7e9c30766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.222623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf81a4-3559-498c-8ba2-6772ae566479 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:30.232545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf81a4-3559-498c-8ba2-6772ae566479 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:30.237303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750d29a-d4b8-4f70-8292-2ac72625cd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:30.238133 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750d29a-d4b8-4f70-8292-2ac72625cd51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.238444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750d29a-d4b8-4f70-8292-2ac72625cd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.238674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e873ec44-7c6c-429f-9d3b-2cd7e9c30766 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:30.238782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750d29a-d4b8-4f70-8292-2ac72625cd51 admin admin] PATH_INFO: `/v3/system/users/c5e9534f03564c78acf854ad48e19a11/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.239829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e873ec44-7c6c-429f-9d3b-2cd7e9c30766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:30.240161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750d29a-d4b8-4f70-8292-2ac72625cd51 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c5e9534f03564c78acf854ad48e19a11, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:30.241156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-a750d29a-d4b8-4f70-8292-2ac72625cd51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:30.241156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:25:30.241156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:25:30.242020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750d29a-d4b8-4f70-8292-2ac72625cd51 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:30.247165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 153/308] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:30.248399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f342b-2469-4d16-9abf-8aa25ff99295 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.248742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f342b-2469-4d16-9abf-8aa25ff99295 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.249033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f342b-2469-4d16-9abf-8aa25ff99295 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.251164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 154/309] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:30.252952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 156/310] 10.222.0.79 () {58 vars in 1355 bytes} [Mon Feb 21 01:25:30 2022] PUT /identity/v3/system/users/c5e9534f03564c78acf854ad48e19a11/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:25:30.256171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01546e-6fbc-4732-b5f2-848b5bbc8b61 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.256736 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01546e-6fbc-4732-b5f2-848b5bbc8b61 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.257018 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01546e-6fbc-4732-b5f2-848b5bbc8b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.272659 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750d29a-d4b8-4f70-8292-2ac72625cd51 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:30.276302 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-cb01546e-6fbc-4732-b5f2-848b5bbc8b61 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:30.277494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-cb01546e-6fbc-4732-b5f2-848b5bbc8b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:30.283871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750d29a-d4b8-4f70-8292-2ac72625cd51 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:30.286517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 155/311] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:30.292542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77c353-07cc-4298-8b12-ce092d069edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:30.293259 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77c353-07cc-4298-8b12-ce092d069edd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.293648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77c353-07cc-4298-8b12-ce092d069edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.293922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77c353-07cc-4298-8b12-ce092d069edd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.295266 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77c353-07cc-4298-8b12-ce092d069edd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:30.297122 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77c353-07cc-4298-8b12-ce092d069edd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:30.303795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 157/312] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:30.304756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01546e-6fbc-4732-b5f2-848b5bbc8b61 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:30.309785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77c353-07cc-4298-8b12-ce092d069edd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:30.314850 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01546e-6fbc-4732-b5f2-848b5bbc8b61 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:30.319420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99ed1c-fe39-4164-a748-1095cf9bb7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:30.319965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77c353-07cc-4298-8b12-ce092d069edd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:30.320136 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99ed1c-fe39-4164-a748-1095cf9bb7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.320383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99ed1c-fe39-4164-a748-1095cf9bb7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.320710 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99ed1c-fe39-4164-a748-1095cf9bb7c9 admin admin] PATH_INFO: `/v3/groups` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.321346 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99ed1c-fe39-4164-a748-1095cf9bb7c9 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:30.322408 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-da99ed1c-fe39-4164-a748-1095cf9bb7c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:30.322408 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:25:30.322408 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:25:30.323611 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99ed1c-fe39-4164-a748-1095cf9bb7c9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:30.324596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f5667-47f5-47e4-b432-64af1d3b4466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:30.325393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f5667-47f5-47e4-b432-64af1d3b4466 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.325724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f5667-47f5-47e4-b432-64af1d3b4466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.325997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f5667-47f5-47e4-b432-64af1d3b4466 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.338255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f5667-47f5-47e4-b432-64af1d3b4466 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:30.340135 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 156/313] 10.222.0.79 () {60 vars in 1155 bytes} [Mon Feb 21 01:25:30 2022] POST /identity/v3/groups => generated 229 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:25:30.346174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-dc2f5667-47f5-47e4-b432-64af1d3b4466 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:25:30.347665 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 158/314] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:30.353913 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99ed1c-fe39-4164-a748-1095cf9bb7c9 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:30.364936 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99ed1c-fe39-4164-a748-1095cf9bb7c9 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:30.369660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b3025-c2de-4548-858e-243df5b70c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:30.370399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b3025-c2de-4548-858e-243df5b70c5e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.370685 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b3025-c2de-4548-858e-243df5b70c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.370962 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b3025-c2de-4548-858e-243df5b70c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.371759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b3025-c2de-4548-858e-243df5b70c5e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:30.372066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b3025-c2de-4548-858e-243df5b70c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:30.373764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b3025-c2de-4548-858e-243df5b70c5e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:30.384170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 157/315] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:30.390903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f5667-47f5-47e4-b432-64af1d3b4466 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:30.411042 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f5667-47f5-47e4-b432-64af1d3b4466 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:30.415686 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50339211-045e-43da-9c60-137873f19248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:30.416580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50339211-045e-43da-9c60-137873f19248 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.416859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50339211-045e-43da-9c60-137873f19248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.417134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50339211-045e-43da-9c60-137873f19248 admin admin] PATH_INFO: `/v3/users/80cefa6b94e4426aa1a017047677fdce` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.432628 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50339211-045e-43da-9c60-137873f19248 admin admin] RBAC: Authorizing `identity:get_user(user_id=80cefa6b94e4426aa1a017047677fdce)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:30.434929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50339211-045e-43da-9c60-137873f19248 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:30.436964 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 159/316] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:30 2022] GET /identity/v3/users/80cefa6b94e4426aa1a017047677fdce => generated 293 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:30.443272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b3025-c2de-4548-858e-243df5b70c5e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:30.455173 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b3025-c2de-4548-858e-243df5b70c5e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:30.459797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1354a-0daa-47db-9f68-5361a5d08c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:30.460472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1354a-0daa-47db-9f68-5361a5d08c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:30.460764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1354a-0daa-47db-9f68-5361a5d08c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:30.461045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1354a-0daa-47db-9f68-5361a5d08c78 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:30.461886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1354a-0daa-47db-9f68-5361a5d08c78 admin admin] RBAC: Adding query filter params (role.id=093e9332cf3845ada22785bdc1b21626, user.id=80cefa6b94e4426aa1a017047677fdce, scope.system=all) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:30.462267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1354a-0daa-47db-9f68-5361a5d08c78 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:30.464145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1354a-0daa-47db-9f68-5361a5d08c78 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:30.472020 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 158/317] 10.222.0.79 () {56 vars in 1329 bytes} [Mon Feb 21 01:25:30 2022] GET /identity/v3/role_assignments?user.id=80cefa6b94e4426aa1a017047677fdce&scope.system=all&role.id=093e9332cf3845ada22785bdc1b21626 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:32.575484 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d63376-87d2-462b-8baa-f5e93ca22791 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.576004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d63376-87d2-462b-8baa-f5e93ca22791 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.576081 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d63376-87d2-462b-8baa-f5e93ca22791 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.578574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 160/318] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:32.583585 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324321aa-88d0-4701-89c3-7fea5148cbdf None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.583978 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324321aa-88d0-4701-89c3-7fea5148cbdf None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.584157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324321aa-88d0-4701-89c3-7fea5148cbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.601817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-324321aa-88d0-4701-89c3-7fea5148cbdf None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:32.603030 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-324321aa-88d0-4701-89c3-7fea5148cbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:32.611401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 159/319] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:32.635239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d63376-87d2-462b-8baa-f5e93ca22791 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:32.647960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d63376-87d2-462b-8baa-f5e93ca22791 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:32.652110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fce57-ea91-4435-b6bc-7b8d103e0378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:32.652890 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fce57-ea91-4435-b6bc-7b8d103e0378 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.653168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fce57-ea91-4435-b6bc-7b8d103e0378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.653439 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fce57-ea91-4435-b6bc-7b8d103e0378 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.664663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fce57-ea91-4435-b6bc-7b8d103e0378 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:32.672004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-9e4fce57-ea91-4435-b6bc-7b8d103e0378 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:32.673357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 161/320] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:32.679081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324321aa-88d0-4701-89c3-7fea5148cbdf None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:32.688841 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324321aa-88d0-4701-89c3-7fea5148cbdf None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:32.693500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692d48c-29c2-40a2-903a-56c569838f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:32.694297 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692d48c-29c2-40a2-903a-56c569838f60 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.694679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692d48c-29c2-40a2-903a-56c569838f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.695032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692d48c-29c2-40a2-903a-56c569838f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.695854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692d48c-29c2-40a2-903a-56c569838f60 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:32.696232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692d48c-29c2-40a2-903a-56c569838f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:32.697930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692d48c-29c2-40a2-903a-56c569838f60 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:32.707852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 160/321] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:32.712693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fce57-ea91-4435-b6bc-7b8d103e0378 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:32.722999 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fce57-ea91-4435-b6bc-7b8d103e0378 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:32.727320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4a4d2-163b-4c7d-839a-8b22271a040f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:32.728177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4a4d2-163b-4c7d-839a-8b22271a040f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.728457 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4a4d2-163b-4c7d-839a-8b22271a040f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.728724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4a4d2-163b-4c7d-839a-8b22271a040f admin admin] PATH_INFO: `/v3/users/c5e9534f03564c78acf854ad48e19a11` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.729911 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4a4d2-163b-4c7d-839a-8b22271a040f admin admin] RBAC: Authorizing `identity:get_user(user_id=c5e9534f03564c78acf854ad48e19a11)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:32.732091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4a4d2-163b-4c7d-839a-8b22271a040f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:32.734793 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 162/322] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:32 2022] GET /identity/v3/users/c5e9534f03564c78acf854ad48e19a11 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:32.737729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af038ea3-aa6f-4e2b-abae-9988ac5ee1cd None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.738019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af038ea3-aa6f-4e2b-abae-9988ac5ee1cd None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.738461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af038ea3-aa6f-4e2b-abae-9988ac5ee1cd None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.739924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4a4d2-163b-4c7d-839a-8b22271a040f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:32.740566 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 161/323] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:32.745808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdedfa4-077c-4b49-a39c-5da5b3bc56f4 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.746090 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdedfa4-077c-4b49-a39c-5da5b3bc56f4 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.746395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdedfa4-077c-4b49-a39c-5da5b3bc56f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.753678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4a4d2-163b-4c7d-839a-8b22271a040f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:32.759402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f214b-a80d-4759-ba2c-350fe5e62b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:32.760102 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f214b-a80d-4759-ba2c-350fe5e62b3a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.760439 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f214b-a80d-4759-ba2c-350fe5e62b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.760711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f214b-a80d-4759-ba2c-350fe5e62b3a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.761536 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f214b-a80d-4759-ba2c-350fe5e62b3a admin admin] RBAC: Adding query filter params (role.id=3d85c07c87374b898492488d6e608a27, user.id=c5e9534f03564c78acf854ad48e19a11, scope.system=all) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:32.761839 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f214b-a80d-4759-ba2c-350fe5e62b3a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:32.763686 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f214b-a80d-4759-ba2c-350fe5e62b3a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:32.764897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4cdedfa4-077c-4b49-a39c-5da5b3bc56f4 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:32.766078 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4cdedfa4-077c-4b49-a39c-5da5b3bc56f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:32.773556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 162/324] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:32.774985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52332-6d24-493b-85d1-e2776bf3896d None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.775271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52332-6d24-493b-85d1-e2776bf3896d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.775544 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52332-6d24-493b-85d1-e2776bf3896d None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.777313 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 163/325] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:32.782619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c8bd-8185-4376-beda-c27bbe8f446f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.782903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c8bd-8185-4376-beda-c27bbe8f446f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.783171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c8bd-8185-4376-beda-c27bbe8f446f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.790347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 163/326] 10.222.0.79 () {56 vars in 1329 bytes} [Mon Feb 21 01:25:32 2022] GET /identity/v3/role_assignments?user.id=c5e9534f03564c78acf854ad48e19a11&scope.system=all&role.id=3d85c07c87374b898492488d6e608a27 => generated 510 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:32.798775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f214b-a80d-4759-ba2c-350fe5e62b3a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:32.808383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-a565c8bd-8185-4376-beda-c27bbe8f446f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:32.809286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a565c8bd-8185-4376-beda-c27bbe8f446f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:32.811969 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f214b-a80d-4759-ba2c-350fe5e62b3a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:32.817023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfccdf0-8eaa-4918-884f-f485275859b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:32.817835 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfccdf0-8eaa-4918-884f-f485275859b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.818113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfccdf0-8eaa-4918-884f-f485275859b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.818411 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfccdf0-8eaa-4918-884f-f485275859b0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.819662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfccdf0-8eaa-4918-884f-f485275859b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:32.821489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfccdf0-8eaa-4918-884f-f485275859b0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:32.823405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 164/327] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:32.823771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 164/328] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:32.831526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfccdf0-8eaa-4918-884f-f485275859b0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:32.841098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565c8bd-8185-4376-beda-c27bbe8f446f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:32.841678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfccdf0-8eaa-4918-884f-f485275859b0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:32.846392 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9379109-6edd-4d8f-abe0-fa1f3bf4dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:32.847071 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9379109-6edd-4d8f-abe0-fa1f3bf4dd2c admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.847349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9379109-6edd-4d8f-abe0-fa1f3bf4dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.847625 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9379109-6edd-4d8f-abe0-fa1f3bf4dd2c admin admin] PATH_INFO: `/v3/groups` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.848350 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9379109-6edd-4d8f-abe0-fa1f3bf4dd2c admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:32.849926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-c9379109-6edd-4d8f-abe0-fa1f3bf4dd2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:32.849926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:25:32.849926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:25:32.851903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565c8bd-8185-4376-beda-c27bbe8f446f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:32.852233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9379109-6edd-4d8f-abe0-fa1f3bf4dd2c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:32.856786 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c29724-48e0-4b81-8a15-62aa9cc43bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:32.857832 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c29724-48e0-4b81-8a15-62aa9cc43bca admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.858286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c29724-48e0-4b81-8a15-62aa9cc43bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.858716 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c29724-48e0-4b81-8a15-62aa9cc43bca admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.872855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c29724-48e0-4b81-8a15-62aa9cc43bca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:32.873861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 165/329] 10.222.0.79 () {60 vars in 1155 bytes} [Mon Feb 21 01:25:32 2022] POST /identity/v3/groups => generated 226 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:32.880853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-85c29724-48e0-4b81-8a15-62aa9cc43bca admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:25:32.882437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 165/330] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:32.888807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9379109-6edd-4d8f-abe0-fa1f3bf4dd2c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:32.899535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9379109-6edd-4d8f-abe0-fa1f3bf4dd2c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:32.904092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d5d9-0bd6-46ee-9aa8-d48978738a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:32.904774 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d5d9-0bd6-46ee-9aa8-d48978738a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.905243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d5d9-0bd6-46ee-9aa8-d48978738a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.905522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d5d9-0bd6-46ee-9aa8-d48978738a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.906885 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d5d9-0bd6-46ee-9aa8-d48978738a23 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:32.907255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d5d9-0bd6-46ee-9aa8-d48978738a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:32.908972 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d5d9-0bd6-46ee-9aa8-d48978738a23 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:32.919310 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 166/331] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:32.925775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c29724-48e0-4b81-8a15-62aa9cc43bca admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:32.935973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c29724-48e0-4b81-8a15-62aa9cc43bca admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:32.940767 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4292e5-ce75-41a9-ad5a-c1e1da64303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:32.941692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4292e5-ce75-41a9-ad5a-c1e1da64303d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.941976 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4292e5-ce75-41a9-ad5a-c1e1da64303d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.942282 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4292e5-ce75-41a9-ad5a-c1e1da64303d admin admin] PATH_INFO: `/v3/users/80cefa6b94e4426aa1a017047677fdce` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.943739 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4292e5-ce75-41a9-ad5a-c1e1da64303d admin admin] RBAC: Authorizing `identity:get_user(user_id=80cefa6b94e4426aa1a017047677fdce)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:32.946008 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4292e5-ce75-41a9-ad5a-c1e1da64303d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:32.948104 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 166/332] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:32 2022] GET /identity/v3/users/80cefa6b94e4426aa1a017047677fdce => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:32.954048 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d5d9-0bd6-46ee-9aa8-d48978738a23 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:32.964360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d5d9-0bd6-46ee-9aa8-d48978738a23 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:32.969566 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434698d-eb8a-4dbd-9c5c-4076ce62373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:32.970520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434698d-eb8a-4dbd-9c5c-4076ce62373e admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.970874 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434698d-eb8a-4dbd-9c5c-4076ce62373e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.971150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434698d-eb8a-4dbd-9c5c-4076ce62373e admin admin] PATH_INFO: `/v3/system/users/80cefa6b94e4426aa1a017047677fdce/roles/093e9332cf3845ada22785bdc1b21626` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.972837 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434698d-eb8a-4dbd-9c5c-4076ce62373e admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=80cefa6b94e4426aa1a017047677fdce, role_id=093e9332cf3845ada22785bdc1b21626)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:32.974545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434698d-eb8a-4dbd-9c5c-4076ce62373e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:32.983104 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 167/333] 10.222.0.79 () {58 vars in 1355 bytes} [Mon Feb 21 01:25:32 2022] PUT /identity/v3/system/users/80cefa6b94e4426aa1a017047677fdce/roles/093e9332cf3845ada22785bdc1b21626 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:35.442160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473cf9a-78b5-4178-803c-428c99fc451b None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:35.442160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473cf9a-78b5-4178-803c-428c99fc451b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:35.442160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473cf9a-78b5-4178-803c-428c99fc451b None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:35.442160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 167/334] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:35.448650 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c2c6d-d5d6-493f-be87-26e5d9656b98 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:35.449449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c2c6d-d5d6-493f-be87-26e5d9656b98 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:35.449700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c2c6d-d5d6-493f-be87-26e5d9656b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:35.486162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a11c2c6d-d5d6-493f-be87-26e5d9656b98 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:35.488144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a11c2c6d-d5d6-493f-be87-26e5d9656b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:35.509716 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 168/335] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:35.535295 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473cf9a-78b5-4178-803c-428c99fc451b None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:35.560053 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473cf9a-78b5-4178-803c-428c99fc451b None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:35.573481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb3ed4-94a1-4018-aa52-7469c3fc7499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:35.578595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb3ed4-94a1-4018-aa52-7469c3fc7499 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:35.579366 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb3ed4-94a1-4018-aa52-7469c3fc7499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:35.580082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb3ed4-94a1-4018-aa52-7469c3fc7499 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:35.604114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb3ed4-94a1-4018-aa52-7469c3fc7499 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:35.623181 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-35cb3ed4-94a1-4018-aa52-7469c3fc7499 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:25:35.626416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 168/336] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:35.634087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c2c6d-d5d6-493f-be87-26e5d9656b98 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:35.662573 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c2c6d-d5d6-493f-be87-26e5d9656b98 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:35.677167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069b1dd-375e-48f2-b262-bdb2406d77bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:35.678263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069b1dd-375e-48f2-b262-bdb2406d77bc admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:35.678757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069b1dd-375e-48f2-b262-bdb2406d77bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:35.679242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069b1dd-375e-48f2-b262-bdb2406d77bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:35.680599 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069b1dd-375e-48f2-b262-bdb2406d77bc admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:35.681147 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069b1dd-375e-48f2-b262-bdb2406d77bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:35.684184 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069b1dd-375e-48f2-b262-bdb2406d77bc admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:35.706793 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 169/337] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:35.712923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb3ed4-94a1-4018-aa52-7469c3fc7499 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:35.736625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb3ed4-94a1-4018-aa52-7469c3fc7499 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:35.750588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041904a-b128-48b9-b744-1602864686db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:35.752470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041904a-b128-48b9-b744-1602864686db admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:35.753210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041904a-b128-48b9-b744-1602864686db admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:35.753953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041904a-b128-48b9-b744-1602864686db admin admin] PATH_INFO: `/v3/users/80cefa6b94e4426aa1a017047677fdce` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:35.756325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041904a-b128-48b9-b744-1602864686db admin admin] RBAC: Authorizing `identity:get_user(user_id=80cefa6b94e4426aa1a017047677fdce)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:35.760654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041904a-b128-48b9-b744-1602864686db admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:35.766629 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 169/338] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:25:35 2022] GET /identity/v3/users/80cefa6b94e4426aa1a017047677fdce => generated 293 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:35.776493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069b1dd-375e-48f2-b262-bdb2406d77bc admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:35.806141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069b1dd-375e-48f2-b262-bdb2406d77bc admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:35.821967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c3652-9f29-486a-bece-806be5045f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:35.823064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c3652-9f29-486a-bece-806be5045f45 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:35.823548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c3652-9f29-486a-bece-806be5045f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:35.824022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c3652-9f29-486a-bece-806be5045f45 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:35.825530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c3652-9f29-486a-bece-806be5045f45 admin admin] RBAC: Adding query filter params (role.id=093e9332cf3845ada22785bdc1b21626, user.id=80cefa6b94e4426aa1a017047677fdce, scope.system=all) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:35.826064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c3652-9f29-486a-bece-806be5045f45 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:35.829656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c3652-9f29-486a-bece-806be5045f45 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:35.864635 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 170/339] 10.222.0.79 () {56 vars in 1329 bytes} [Mon Feb 21 01:25:35 2022] GET /identity/v3/role_assignments?user.id=80cefa6b94e4426aa1a017047677fdce&scope.system=all&role.id=093e9332cf3845ada22785bdc1b21626 => generated 510 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:35.918544 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e2711-e642-4842-b715-0e0eb146261a None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:35.919010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e2711-e642-4842-b715-0e0eb146261a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:35.919478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e2711-e642-4842-b715-0e0eb146261a None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:35.922951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 170/340] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:35.933025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5981-93ba-4730-8e25-6edd429e2899 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:35.933489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5981-93ba-4730-8e25-6edd429e2899 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:35.933942 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5981-93ba-4730-8e25-6edd429e2899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:35.974513 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a8ee5981-93ba-4730-8e25-6edd429e2899 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:35.976328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a8ee5981-93ba-4730-8e25-6edd429e2899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:35.993490 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 171/341] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:36.063948 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e2711-e642-4842-b715-0e0eb146261a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.084809 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c2f04-5c1a-42e3-ad58-5ddff12991e6 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.085203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c2f04-5c1a-42e3-ad58-5ddff12991e6 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.085380 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c2f04-5c1a-42e3-ad58-5ddff12991e6 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.087384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 172/342] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:36.088047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e2711-e642-4842-b715-0e0eb146261a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.098293 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3be75-e762-4979-a206-dec3195dc1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.101536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3be75-e762-4979-a206-dec3195dc1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.101536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3be75-e762-4979-a206-dec3195dc1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.101536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3be75-e762-4979-a206-dec3195dc1d6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.103781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413e793-6c8c-40a6-8e9e-06c447041aff None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.104215 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413e793-6c8c-40a6-8e9e-06c447041aff None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.104647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413e793-6c8c-40a6-8e9e-06c447041aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.133477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3be75-e762-4979-a206-dec3195dc1d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:36.158726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-c7c3be75-e762-4979-a206-dec3195dc1d6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:36.160316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 171/343] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:36.168795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-1413e793-6c8c-40a6-8e9e-06c447041aff None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:36.170778 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1413e793-6c8c-40a6-8e9e-06c447041aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:36.177483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3be75-e762-4979-a206-dec3195dc1d6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.196208 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3be75-e762-4979-a206-dec3195dc1d6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.198272 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 173/344] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:36.202231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ceb0ab-82cd-4de5-b9e4-a3feccc7c3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.203575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceb0ab-82cd-4de5-b9e4-a3feccc7c3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.203858 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceb0ab-82cd-4de5-b9e4-a3feccc7c3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.204128 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceb0ab-82cd-4de5-b9e4-a3feccc7c3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.204933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ceb0ab-82cd-4de5-b9e4-a3feccc7c3b5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:36.205240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ceb0ab-82cd-4de5-b9e4-a3feccc7c3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:36.206872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ceb0ab-82cd-4de5-b9e4-a3feccc7c3b5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:36.219305 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 172/345] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:36.227885 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413e793-6c8c-40a6-8e9e-06c447041aff None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.238409 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413e793-6c8c-40a6-8e9e-06c447041aff None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.239993 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ceb0ab-82cd-4de5-b9e4-a3feccc7c3b5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.254267 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6343c-05fa-476b-b8f9-5490cbcb2071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.254935 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6343c-05fa-476b-b8f9-5490cbcb2071 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.255210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6343c-05fa-476b-b8f9-5490cbcb2071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.255476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6343c-05fa-476b-b8f9-5490cbcb2071 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.258961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ceb0ab-82cd-4de5-b9e4-a3feccc7c3b5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.273701 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6343c-05fa-476b-b8f9-5490cbcb2071 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:36.275533 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6343c-05fa-476b-b8f9-5490cbcb2071 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:36.281794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9afd28-24b5-474b-bdd2-5388746d8d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.282665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9afd28-24b5-474b-bdd2-5388746d8d17 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.282938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9afd28-24b5-474b-bdd2-5388746d8d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.283207 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9afd28-24b5-474b-bdd2-5388746d8d17 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.293954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 174/346] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:36.299847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9afd28-24b5-474b-bdd2-5388746d8d17 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:36.302829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6343c-05fa-476b-b8f9-5490cbcb2071 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.312886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-4d9afd28-24b5-474b-bdd2-5388746d8d17 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:36.314142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 173/347] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:36.321731 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6343c-05fa-476b-b8f9-5490cbcb2071 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.323291 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9afd28-24b5-474b-bdd2-5388746d8d17 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.332606 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefefaf8-73e3-454e-af6e-fd3b04b828d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.334096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefefaf8-73e3-454e-af6e-fd3b04b828d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.338962 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefefaf8-73e3-454e-af6e-fd3b04b828d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.339428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefefaf8-73e3-454e-af6e-fd3b04b828d1 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.342763 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefefaf8-73e3-454e-af6e-fd3b04b828d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:36.346063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9afd28-24b5-474b-bdd2-5388746d8d17 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.346838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefefaf8-73e3-454e-af6e-fd3b04b828d1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:36.350759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 175/348] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:36.354708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f83e1a-f16c-4c64-9687-ba6aea536810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.355383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83e1a-f16c-4c64-9687-ba6aea536810 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.355663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83e1a-f16c-4c64-9687-ba6aea536810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.355937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83e1a-f16c-4c64-9687-ba6aea536810 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.356872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f83e1a-f16c-4c64-9687-ba6aea536810 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:36.357181 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f83e1a-f16c-4c64-9687-ba6aea536810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:36.358548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefefaf8-73e3-454e-af6e-fd3b04b828d1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.359494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f83e1a-f16c-4c64-9687-ba6aea536810 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:36.378831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 174/349] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:36.380503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefefaf8-73e3-454e-af6e-fd3b04b828d1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.384909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f83e1a-f16c-4c64-9687-ba6aea536810 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.388530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658548b-3fb7-41cb-b871-f47ce9a0bdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.389678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658548b-3fb7-41cb-b871-f47ce9a0bdea admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.390656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658548b-3fb7-41cb-b871-f47ce9a0bdea admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.396331 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658548b-3fb7-41cb-b871-f47ce9a0bdea admin admin] PATH_INFO: `/v3/groups/62d1d36b55ef431e9c4b80dc4e250723` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.406971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f83e1a-f16c-4c64-9687-ba6aea536810 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.410672 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658548b-3fb7-41cb-b871-f47ce9a0bdea admin admin] RBAC: Authorizing `identity:get_group(group_id=62d1d36b55ef431e9c4b80dc4e250723)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:36.411715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-7658548b-3fb7-41cb-b871-f47ce9a0bdea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:36.411715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:25:36.411715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:25:36.412892 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658548b-3fb7-41cb-b871-f47ce9a0bdea admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:36.414608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 176/350] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/groups/62d1d36b55ef431e9c4b80dc4e250723 => generated 226 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:36.417848 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150bf79-2e9d-44a7-9243-1f86eaa663b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.418525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150bf79-2e9d-44a7-9243-1f86eaa663b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.418803 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150bf79-2e9d-44a7-9243-1f86eaa663b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.419071 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150bf79-2e9d-44a7-9243-1f86eaa663b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.423646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658548b-3fb7-41cb-b871-f47ce9a0bdea admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.435132 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150bf79-2e9d-44a7-9243-1f86eaa663b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:36.438478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658548b-3fb7-41cb-b871-f47ce9a0bdea admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.439821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150bf79-2e9d-44a7-9243-1f86eaa663b6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:36.447755 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499400a-b3e3-4dba-86d7-2906614a7628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.448401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499400a-b3e3-4dba-86d7-2906614a7628 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.448843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499400a-b3e3-4dba-86d7-2906614a7628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.449777 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499400a-b3e3-4dba-86d7-2906614a7628 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.450783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499400a-b3e3-4dba-86d7-2906614a7628 admin admin] RBAC: Adding query filter params (group.id=62d1d36b55ef431e9c4b80dc4e250723, role.id=289d1250826d4384990c8f3d403bc047, scope.project.id=3c4f1a5a685848d5bd703ae910481be2) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:36.451237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499400a-b3e3-4dba-86d7-2906614a7628 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:36.453776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499400a-b3e3-4dba-86d7-2906614a7628 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:36.455627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 175/351] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:25:36.462680 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150bf79-2e9d-44a7-9243-1f86eaa663b6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.465358 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 177/352] 10.222.0.79 () {56 vars in 1397 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/role_assignments?group.id=62d1d36b55ef431e9c4b80dc4e250723&scope.project.id=3c4f1a5a685848d5bd703ae910481be2&role.id=289d1250826d4384990c8f3d403bc047 => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:36.479254 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150bf79-2e9d-44a7-9243-1f86eaa663b6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.484067 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222b8c2-4f9b-432c-b8a0-a9fc5aa6aab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.484958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222b8c2-4f9b-432c-b8a0-a9fc5aa6aab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.485266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222b8c2-4f9b-432c-b8a0-a9fc5aa6aab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.485540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222b8c2-4f9b-432c-b8a0-a9fc5aa6aab1 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.486953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222b8c2-4f9b-432c-b8a0-a9fc5aa6aab1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:36.489140 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222b8c2-4f9b-432c-b8a0-a9fc5aa6aab1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:36.491058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 176/353] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:36.496874 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499400a-b3e3-4dba-86d7-2906614a7628 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.508736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499400a-b3e3-4dba-86d7-2906614a7628 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.513517 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989348a-e77f-4727-a441-a2d029adacb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.515549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989348a-e77f-4727-a441-a2d029adacb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.515549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989348a-e77f-4727-a441-a2d029adacb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.515549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989348a-e77f-4727-a441-a2d029adacb8 admin admin] PATH_INFO: `/v3/groups/62d1d36b55ef431e9c4b80dc4e250723` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.516676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989348a-e77f-4727-a441-a2d029adacb8 admin admin] RBAC: Authorizing `identity:get_group(group_id=62d1d36b55ef431e9c4b80dc4e250723)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:36.518629 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989348a-e77f-4727-a441-a2d029adacb8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:36.520569 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 178/354] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/groups/62d1d36b55ef431e9c4b80dc4e250723 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:36.526165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222b8c2-4f9b-432c-b8a0-a9fc5aa6aab1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.536957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222b8c2-4f9b-432c-b8a0-a9fc5aa6aab1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.541416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbea05d-5942-47ec-953d-e73d7cb24748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.542076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea05d-5942-47ec-953d-e73d7cb24748 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.542397 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea05d-5942-47ec-953d-e73d7cb24748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.542670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea05d-5942-47ec-953d-e73d7cb24748 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.543603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbea05d-5942-47ec-953d-e73d7cb24748 admin admin] RBAC: Adding query filter params (group.id=62d1d36b55ef431e9c4b80dc4e250723, role.id=3d85c07c87374b898492488d6e608a27, scope.project.id=3c4f1a5a685848d5bd703ae910481be2) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:36.543908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbea05d-5942-47ec-953d-e73d7cb24748 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:36.545743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbea05d-5942-47ec-953d-e73d7cb24748 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:36.554800 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 177/355] 10.222.0.79 () {56 vars in 1397 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/role_assignments?group.id=62d1d36b55ef431e9c4b80dc4e250723&scope.project.id=3c4f1a5a685848d5bd703ae910481be2&role.id=3d85c07c87374b898492488d6e608a27 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:37.216768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38decb-fabd-4dff-92a3-f17ff9112311 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:37.217127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38decb-fabd-4dff-92a3-f17ff9112311 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:37.217313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38decb-fabd-4dff-92a3-f17ff9112311 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:37.219365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 179/356] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:37.225526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a37a6-23c9-466e-86c7-bbc7ea09ecd9 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:37.225818 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a37a6-23c9-466e-86c7-bbc7ea09ecd9 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:37.226097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a37a6-23c9-466e-86c7-bbc7ea09ecd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:37.245221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-6a0a37a6-23c9-466e-86c7-bbc7ea09ecd9 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:37.246428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6a0a37a6-23c9-466e-86c7-bbc7ea09ecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:37.256737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 178/357] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:37.280061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38decb-fabd-4dff-92a3-f17ff9112311 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:37.293134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38decb-fabd-4dff-92a3-f17ff9112311 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:37.298189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507d232-3182-4db9-b092-36c7c05e8dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:37.299004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507d232-3182-4db9-b092-36c7c05e8dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:37.299285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507d232-3182-4db9-b092-36c7c05e8dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:37.299556 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507d232-3182-4db9-b092-36c7c05e8dbc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:37.319324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507d232-3182-4db9-b092-36c7c05e8dbc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:37.326177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-3507d232-3182-4db9-b092-36c7c05e8dbc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:37.327404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 180/358] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:37.333042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a37a6-23c9-466e-86c7-bbc7ea09ecd9 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:37.342003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a37a6-23c9-466e-86c7-bbc7ea09ecd9 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:37.350046 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5f684-39e3-48c4-a792-456019db1eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:37.350690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5f684-39e3-48c4-a792-456019db1eae admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:37.350970 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5f684-39e3-48c4-a792-456019db1eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:37.351241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5f684-39e3-48c4-a792-456019db1eae admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:37.351998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5f684-39e3-48c4-a792-456019db1eae admin admin] RBAC: Adding query filter params (name=member) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:37.352301 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5f684-39e3-48c4-a792-456019db1eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:37.353902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5f684-39e3-48c4-a792-456019db1eae admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:37.365448 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 179/359] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:37.370966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507d232-3182-4db9-b092-36c7c05e8dbc admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:37.387522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507d232-3182-4db9-b092-36c7c05e8dbc admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:37.392612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d56879-0ff6-4620-bc3f-ca1aee9a79c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:37.393265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d56879-0ff6-4620-bc3f-ca1aee9a79c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:37.393549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d56879-0ff6-4620-bc3f-ca1aee9a79c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:37.393825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d56879-0ff6-4620-bc3f-ca1aee9a79c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:37.406585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d56879-0ff6-4620-bc3f-ca1aee9a79c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:37.408346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d56879-0ff6-4620-bc3f-ca1aee9a79c8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:37.424258 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 181/360] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:37.429835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5f684-39e3-48c4-a792-456019db1eae admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:37.439763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5f684-39e3-48c4-a792-456019db1eae admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:37.449924 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299843d-75ea-4992-9861-6e713979431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:37.450816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299843d-75ea-4992-9861-6e713979431c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:37.451096 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299843d-75ea-4992-9861-6e713979431c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:37.451371 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299843d-75ea-4992-9861-6e713979431c admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:37.452593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299843d-75ea-4992-9861-6e713979431c admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:37.454670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299843d-75ea-4992-9861-6e713979431c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:37.456476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 180/361] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:37 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:37.462999 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d56879-0ff6-4620-bc3f-ca1aee9a79c8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:37.476418 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d56879-0ff6-4620-bc3f-ca1aee9a79c8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:37.481072 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9a752-008f-4ece-8b47-46f3f1f92d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:37.481925 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9a752-008f-4ece-8b47-46f3f1f92d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:37.482225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9a752-008f-4ece-8b47-46f3f1f92d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:37.482504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9a752-008f-4ece-8b47-46f3f1f92d7b admin admin] PATH_INFO: `/v3/groups/62d1d36b55ef431e9c4b80dc4e250723` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:37.484239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9a752-008f-4ece-8b47-46f3f1f92d7b admin admin] RBAC: Authorizing `identity:get_group(group_id=62d1d36b55ef431e9c4b80dc4e250723)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:37.486139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9a752-008f-4ece-8b47-46f3f1f92d7b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:37.488003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 182/362] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:37 2022] GET /identity/v3/groups/62d1d36b55ef431e9c4b80dc4e250723 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:37.493854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299843d-75ea-4992-9861-6e713979431c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:37.507246 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299843d-75ea-4992-9861-6e713979431c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:37.511729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef02b1d-c297-4d01-a42c-3c31094fddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:37.512381 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef02b1d-c297-4d01-a42c-3c31094fddca admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:37.512659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef02b1d-c297-4d01-a42c-3c31094fddca admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:37.512933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef02b1d-c297-4d01-a42c-3c31094fddca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:37.513758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef02b1d-c297-4d01-a42c-3c31094fddca admin admin] RBAC: Adding query filter params (group.id=62d1d36b55ef431e9c4b80dc4e250723, role.id=3d85c07c87374b898492488d6e608a27, scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:37.514066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef02b1d-c297-4d01-a42c-3c31094fddca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:37.515968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef02b1d-c297-4d01-a42c-3c31094fddca admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:37.522335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 181/363] 10.222.0.79 () {56 vars in 1397 bytes} [Mon Feb 21 01:25:37 2022] GET /identity/v3/role_assignments?group.id=62d1d36b55ef431e9c4b80dc4e250723&scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194&role.id=3d85c07c87374b898492488d6e608a27 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:38.064816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fdcda-96be-4b16-a17b-b3416db4e9a1 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.065344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fdcda-96be-4b16-a17b-b3416db4e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.065765 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fdcda-96be-4b16-a17b-b3416db4e9a1 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.067973 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 183/364] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:38.074061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a9e5-2793-4f3d-b2c8-4c149990d76e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.074636 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a9e5-2793-4f3d-b2c8-4c149990d76e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.075061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a9e5-2793-4f3d-b2c8-4c149990d76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.096223 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-a352a9e5-2793-4f3d-b2c8-4c149990d76e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:38.097137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a352a9e5-2793-4f3d-b2c8-4c149990d76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:38.108364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 182/365] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:38.149127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fdcda-96be-4b16-a17b-b3416db4e9a1 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:38.164468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fdcda-96be-4b16-a17b-b3416db4e9a1 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:38.175141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe54a22-92ad-4f9a-b1e0-ea1f42f4c922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:38.176292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54a22-92ad-4f9a-b1e0-ea1f42f4c922 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.176747 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54a22-92ad-4f9a-b1e0-ea1f42f4c922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.177197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54a22-92ad-4f9a-b1e0-ea1f42f4c922 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.191283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe54a22-92ad-4f9a-b1e0-ea1f42f4c922 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:38.198830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-8fe54a22-92ad-4f9a-b1e0-ea1f42f4c922 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:38.200249 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 184/366] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:38.206275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a9e5-2793-4f3d-b2c8-4c149990d76e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:38.220247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a9e5-2793-4f3d-b2c8-4c149990d76e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:38.229743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6d0e0-e8fc-43b2-ac03-276bb94f7f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:38.230451 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6d0e0-e8fc-43b2-ac03-276bb94f7f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.230730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6d0e0-e8fc-43b2-ac03-276bb94f7f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.231002 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6d0e0-e8fc-43b2-ac03-276bb94f7f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.231758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6d0e0-e8fc-43b2-ac03-276bb94f7f3c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:38.232062 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6d0e0-e8fc-43b2-ac03-276bb94f7f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:38.234232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6d0e0-e8fc-43b2-ac03-276bb94f7f3c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:38.245476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 183/367] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:38.251511 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe54a22-92ad-4f9a-b1e0-ea1f42f4c922 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:38.262118 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe54a22-92ad-4f9a-b1e0-ea1f42f4c922 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:38.277317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb964c-f400-4ded-9f22-c97f76830a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:38.278302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb964c-f400-4ded-9f22-c97f76830a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.278755 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb964c-f400-4ded-9f22-c97f76830a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.279196 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb964c-f400-4ded-9f22-c97f76830a47 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.290230 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb964c-f400-4ded-9f22-c97f76830a47 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:38.292191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb964c-f400-4ded-9f22-c97f76830a47 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:38.305923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 185/368] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:38.311544 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6d0e0-e8fc-43b2-ac03-276bb94f7f3c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:38.327214 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6d0e0-e8fc-43b2-ac03-276bb94f7f3c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:38.337751 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074909ea-f01d-4a73-b0f3-fd08eaf78755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:38.338645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074909ea-f01d-4a73-b0f3-fd08eaf78755 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.338925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074909ea-f01d-4a73-b0f3-fd08eaf78755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.339199 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074909ea-f01d-4a73-b0f3-fd08eaf78755 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.340383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074909ea-f01d-4a73-b0f3-fd08eaf78755 admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:38.342463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074909ea-f01d-4a73-b0f3-fd08eaf78755 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:38.344959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 184/369] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:38 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:38.350307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb964c-f400-4ded-9f22-c97f76830a47 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:38.363434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb964c-f400-4ded-9f22-c97f76830a47 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:38.368561 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdea9c9-282a-4bfe-b6c2-990dc9bf388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:38.369707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdea9c9-282a-4bfe-b6c2-990dc9bf388a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.370160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdea9c9-282a-4bfe-b6c2-990dc9bf388a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.370721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdea9c9-282a-4bfe-b6c2-990dc9bf388a admin admin] PATH_INFO: `/v3/groups/62d1d36b55ef431e9c4b80dc4e250723` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.375861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdea9c9-282a-4bfe-b6c2-990dc9bf388a admin admin] RBAC: Authorizing `identity:get_group(group_id=62d1d36b55ef431e9c4b80dc4e250723)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:38.378056 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdea9c9-282a-4bfe-b6c2-990dc9bf388a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:38.380303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 186/370] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:38 2022] GET /identity/v3/groups/62d1d36b55ef431e9c4b80dc4e250723 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:38.385928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074909ea-f01d-4a73-b0f3-fd08eaf78755 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:38.399464 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074909ea-f01d-4a73-b0f3-fd08eaf78755 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:38.407051 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd420-fcc3-4fb5-988d-758f9de8cfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:38.407715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd420-fcc3-4fb5-988d-758f9de8cfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.408063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd420-fcc3-4fb5-988d-758f9de8cfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.408450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd420-fcc3-4fb5-988d-758f9de8cfb1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.409398 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd420-fcc3-4fb5-988d-758f9de8cfb1 admin admin] RBAC: Adding query filter params (group.id=62d1d36b55ef431e9c4b80dc4e250723, role.id=289d1250826d4384990c8f3d403bc047, scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:38.409711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd420-fcc3-4fb5-988d-758f9de8cfb1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:38.411713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd420-fcc3-4fb5-988d-758f9de8cfb1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:38.422865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 185/371] 10.222.0.79 () {56 vars in 1397 bytes} [Mon Feb 21 01:25:38 2022] GET /identity/v3/role_assignments?group.id=62d1d36b55ef431e9c4b80dc4e250723&scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194&role.id=289d1250826d4384990c8f3d403bc047 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:38.576391 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6135fa0-974e-44ba-b76f-0ee6d6b97c31 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.577430 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6135fa0-974e-44ba-b76f-0ee6d6b97c31 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.577912 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6135fa0-974e-44ba-b76f-0ee6d6b97c31 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.579910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 187/372] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:38.585578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8eadee-50a1-4204-a9e5-563113274d22 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.586051 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8eadee-50a1-4204-a9e5-563113274d22 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.586151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8eadee-50a1-4204-a9e5-563113274d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.615329 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-3a8eadee-50a1-4204-a9e5-563113274d22 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:38.616540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3a8eadee-50a1-4204-a9e5-563113274d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:38.625526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 186/373] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:38.659581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6135fa0-974e-44ba-b76f-0ee6d6b97c31 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:38.679959 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6135fa0-974e-44ba-b76f-0ee6d6b97c31 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:38.686113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984f987-abd5-461f-aea8-5b9b2fd37e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:38.687847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984f987-abd5-461f-aea8-5b9b2fd37e2d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.688328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984f987-abd5-461f-aea8-5b9b2fd37e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.688886 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984f987-abd5-461f-aea8-5b9b2fd37e2d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.705210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984f987-abd5-461f-aea8-5b9b2fd37e2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:38.715713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-5984f987-abd5-461f-aea8-5b9b2fd37e2d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:25:38.717227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 188/374] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:38.723038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8eadee-50a1-4204-a9e5-563113274d22 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:38.735350 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8eadee-50a1-4204-a9e5-563113274d22 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:38.742428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f60fac-b9c5-4d55-9e08-a194b8cff754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:38.743106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f60fac-b9c5-4d55-9e08-a194b8cff754 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.743387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f60fac-b9c5-4d55-9e08-a194b8cff754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.743660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f60fac-b9c5-4d55-9e08-a194b8cff754 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.744425 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f60fac-b9c5-4d55-9e08-a194b8cff754 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:38.744733 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f60fac-b9c5-4d55-9e08-a194b8cff754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:38.746357 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f60fac-b9c5-4d55-9e08-a194b8cff754 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:38.760130 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 187/375] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:38.766482 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984f987-abd5-461f-aea8-5b9b2fd37e2d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:38.776544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984f987-abd5-461f-aea8-5b9b2fd37e2d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:38.784121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921d44f-b228-4a74-8fcf-07fc4433cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:38.785026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921d44f-b228-4a74-8fcf-07fc4433cc92 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.785502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921d44f-b228-4a74-8fcf-07fc4433cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.785972 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921d44f-b228-4a74-8fcf-07fc4433cc92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.795050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921d44f-b228-4a74-8fcf-07fc4433cc92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:38.797591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921d44f-b228-4a74-8fcf-07fc4433cc92 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:38.811411 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 189/376] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:38.817094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f60fac-b9c5-4d55-9e08-a194b8cff754 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:38.831331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f60fac-b9c5-4d55-9e08-a194b8cff754 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:38.841866 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6190ee-9230-4bb0-a566-8d0d8698159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:38.842769 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6190ee-9230-4bb0-a566-8d0d8698159f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.843088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6190ee-9230-4bb0-a566-8d0d8698159f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.843361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6190ee-9230-4bb0-a566-8d0d8698159f admin admin] PATH_INFO: `/v3/projects/442aa4692fdc4c9cbacda48f2343b2fa` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.844559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6190ee-9230-4bb0-a566-8d0d8698159f admin admin] RBAC: Authorizing `identity:get_project(project_id=442aa4692fdc4c9cbacda48f2343b2fa)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:38.846402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6190ee-9230-4bb0-a566-8d0d8698159f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:38.848237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 188/377] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:38 2022] GET /identity/v3/projects/442aa4692fdc4c9cbacda48f2343b2fa => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:38.853679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921d44f-b228-4a74-8fcf-07fc4433cc92 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:38.863626 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921d44f-b228-4a74-8fcf-07fc4433cc92 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:38.871402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c0985-d0c5-47e3-a287-c11972696713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:38.872539 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c0985-d0c5-47e3-a287-c11972696713 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.873013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c0985-d0c5-47e3-a287-c11972696713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.873476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c0985-d0c5-47e3-a287-c11972696713 admin admin] PATH_INFO: `/v3/groups/7711a94b6ccf4182805328debc8e4917` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.883310 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c0985-d0c5-47e3-a287-c11972696713 admin admin] RBAC: Authorizing `identity:get_group(group_id=7711a94b6ccf4182805328debc8e4917)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:38.885504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c0985-d0c5-47e3-a287-c11972696713 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:38.887473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 190/378] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:38 2022] GET /identity/v3/groups/7711a94b6ccf4182805328debc8e4917 => generated 229 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:38.893321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6190ee-9230-4bb0-a566-8d0d8698159f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:38.907877 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6190ee-9230-4bb0-a566-8d0d8698159f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:38.913039 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a50777-e22d-451f-9f57-25befe52d973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:38.913923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a50777-e22d-451f-9f57-25befe52d973 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:38.914459 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a50777-e22d-451f-9f57-25befe52d973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:38.915013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a50777-e22d-451f-9f57-25befe52d973 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:38.916041 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a50777-e22d-451f-9f57-25befe52d973 admin admin] RBAC: Adding query filter params (group.id=7711a94b6ccf4182805328debc8e4917, role.id=548abad662724741a3261205ee7cb828, scope.project.id=442aa4692fdc4c9cbacda48f2343b2fa) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:38.916565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a50777-e22d-451f-9f57-25befe52d973 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:38.919802 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a50777-e22d-451f-9f57-25befe52d973 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:38.932964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 189/379] 10.222.0.79 () {56 vars in 1397 bytes} [Mon Feb 21 01:25:38 2022] GET /identity/v3/role_assignments?group.id=7711a94b6ccf4182805328debc8e4917&scope.project.id=442aa4692fdc4c9cbacda48f2343b2fa&role.id=548abad662724741a3261205ee7cb828 => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:39.575525 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d492d-d476-416c-a9e5-98200ffebfb0 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:39.576207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d492d-d476-416c-a9e5-98200ffebfb0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:39.576703 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d492d-d476-416c-a9e5-98200ffebfb0 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:39.579439 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 191/380] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:39.584812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908a0b0-f2b2-441b-85ff-313d01bb9bd0 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:39.585331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908a0b0-f2b2-441b-85ff-313d01bb9bd0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:39.585801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908a0b0-f2b2-441b-85ff-313d01bb9bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:39.612026 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f908a0b0-f2b2-441b-85ff-313d01bb9bd0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:39.613224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f908a0b0-f2b2-441b-85ff-313d01bb9bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:39.627921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 190/381] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:39.672128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d492d-d476-416c-a9e5-98200ffebfb0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:39.687997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d492d-d476-416c-a9e5-98200ffebfb0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:39.693277 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea6517-1067-4e67-b967-23d8ca78a8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:39.694356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea6517-1067-4e67-b967-23d8ca78a8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:39.694838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea6517-1067-4e67-b967-23d8ca78a8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:39.695309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea6517-1067-4e67-b967-23d8ca78a8d1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:39.715334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea6517-1067-4e67-b967-23d8ca78a8d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:39.723477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-edea6517-1067-4e67-b967-23d8ca78a8d1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:39.725189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 192/382] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:39.730841 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908a0b0-f2b2-441b-85ff-313d01bb9bd0 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:39.745949 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908a0b0-f2b2-441b-85ff-313d01bb9bd0 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:39.761550 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07377750-e38d-4852-a068-00071cceb15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:39.762516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07377750-e38d-4852-a068-00071cceb15f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:39.762977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07377750-e38d-4852-a068-00071cceb15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:39.763410 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07377750-e38d-4852-a068-00071cceb15f admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:39.764317 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07377750-e38d-4852-a068-00071cceb15f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:39.764795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07377750-e38d-4852-a068-00071cceb15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:39.766593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07377750-e38d-4852-a068-00071cceb15f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:39.782719 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 191/383] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:39.788715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea6517-1067-4e67-b967-23d8ca78a8d1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:39.807385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea6517-1067-4e67-b967-23d8ca78a8d1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:39.818359 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22ff8-8854-436a-9003-6a1ca6e6e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:39.819221 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22ff8-8854-436a-9003-6a1ca6e6e85c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:39.819503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22ff8-8854-436a-9003-6a1ca6e6e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:39.819775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22ff8-8854-436a-9003-6a1ca6e6e85c admin admin] PATH_INFO: `/v3/groups/62d1d36b55ef431e9c4b80dc4e250723` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:39.827020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a22ff8-8854-436a-9003-6a1ca6e6e85c admin admin] RBAC: Authorizing `identity:get_group(group_id=62d1d36b55ef431e9c4b80dc4e250723)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:39.828937 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a22ff8-8854-436a-9003-6a1ca6e6e85c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:39.830926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 193/384] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:39 2022] GET /identity/v3/groups/62d1d36b55ef431e9c4b80dc4e250723 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:39.836478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07377750-e38d-4852-a068-00071cceb15f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:39.847633 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07377750-e38d-4852-a068-00071cceb15f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:39.857244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbb5ac-cc34-4608-9852-b3f9c5740e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:39.858439 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbb5ac-cc34-4608-9852-b3f9c5740e49 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:39.859559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbb5ac-cc34-4608-9852-b3f9c5740e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:39.860035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbb5ac-cc34-4608-9852-b3f9c5740e49 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:39.862001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbb5ac-cc34-4608-9852-b3f9c5740e49 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:39.864422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbb5ac-cc34-4608-9852-b3f9c5740e49 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:39.866428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 192/385] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:39 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:39.872613 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22ff8-8854-436a-9003-6a1ca6e6e85c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:39.887661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22ff8-8854-436a-9003-6a1ca6e6e85c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:39.898330 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03a94-3895-4a39-bb69-e29aee6d49b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:39.899207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03a94-3895-4a39-bb69-e29aee6d49b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:39.899488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03a94-3895-4a39-bb69-e29aee6d49b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:39.899768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03a94-3895-4a39-bb69-e29aee6d49b7 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2/groups/62d1d36b55ef431e9c4b80dc4e250723/roles/289d1250826d4384990c8f3d403bc047` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:39.908149 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03a94-3895-4a39-bb69-e29aee6d49b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4f1a5a685848d5bd703ae910481be2, group_id=62d1d36b55ef431e9c4b80dc4e250723, role_id=289d1250826d4384990c8f3d403bc047)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:39.910849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03a94-3895-4a39-bb69-e29aee6d49b7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:39.945003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 194/386] 10.222.0.79 () {58 vars in 1463 bytes} [Mon Feb 21 01:25:39 2022] PUT /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2/groups/62d1d36b55ef431e9c4b80dc4e250723/roles/289d1250826d4384990c8f3d403bc047 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:39.987982 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d209a53-0c84-4f72-89ed-4017b79c6d31 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:39.988636 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d209a53-0c84-4f72-89ed-4017b79c6d31 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:39.989147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d209a53-0c84-4f72-89ed-4017b79c6d31 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:39.991455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 193/387] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:39.996628 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0a93a-d0e5-4db5-88d2-0b3b91a65c9b None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:39.996910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0a93a-d0e5-4db5-88d2-0b3b91a65c9b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:39.997183 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0a93a-d0e5-4db5-88d2-0b3b91a65c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:40.027465 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-32d0a93a-d0e5-4db5-88d2-0b3b91a65c9b None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:40.028684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-32d0a93a-d0e5-4db5-88d2-0b3b91a65c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:40.104817 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 195/388] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:40.144139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d209a53-0c84-4f72-89ed-4017b79c6d31 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:40.163925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d209a53-0c84-4f72-89ed-4017b79c6d31 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:40.174983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbac60-6d69-4514-af1e-716e3e487e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:40.176152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbac60-6d69-4514-af1e-716e3e487e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:40.176638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbac60-6d69-4514-af1e-716e3e487e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:40.177207 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbac60-6d69-4514-af1e-716e3e487e5a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:40.192520 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbac60-6d69-4514-af1e-716e3e487e5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:40.199825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-d3cbac60-6d69-4514-af1e-716e3e487e5a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:40.204388 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 194/389] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:40.207470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0a93a-d0e5-4db5-88d2-0b3b91a65c9b None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:40.219632 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0a93a-d0e5-4db5-88d2-0b3b91a65c9b None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:40.228248 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14543ccc-fdba-4ba4-a795-c0968d246bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:40.228914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14543ccc-fdba-4ba4-a795-c0968d246bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:40.229197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14543ccc-fdba-4ba4-a795-c0968d246bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:40.229473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14543ccc-fdba-4ba4-a795-c0968d246bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:40.230244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14543ccc-fdba-4ba4-a795-c0968d246bd8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:40.230558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14543ccc-fdba-4ba4-a795-c0968d246bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:40.232166 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14543ccc-fdba-4ba4-a795-c0968d246bd8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:40.245671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 196/390] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:40.251129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbac60-6d69-4514-af1e-716e3e487e5a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:40.262118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbac60-6d69-4514-af1e-716e3e487e5a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:40.269381 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb92fc8-c51d-470d-b56a-c587b3c8248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:40.270504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb92fc8-c51d-470d-b56a-c587b3c8248f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:40.270994 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb92fc8-c51d-470d-b56a-c587b3c8248f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:40.271470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb92fc8-c51d-470d-b56a-c587b3c8248f admin admin] PATH_INFO: `/v3/groups/62d1d36b55ef431e9c4b80dc4e250723` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:40.273568 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb92fc8-c51d-470d-b56a-c587b3c8248f admin admin] RBAC: Authorizing `identity:get_group(group_id=62d1d36b55ef431e9c4b80dc4e250723)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:40.274851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-6fb92fc8-c51d-470d-b56a-c587b3c8248f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:40.274851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:25:40.274851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:25:40.276393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb92fc8-c51d-470d-b56a-c587b3c8248f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:40.278392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 195/391] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:40 2022] GET /identity/v3/groups/62d1d36b55ef431e9c4b80dc4e250723 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:40.284573 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14543ccc-fdba-4ba4-a795-c0968d246bd8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:40.294730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14543ccc-fdba-4ba4-a795-c0968d246bd8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:40.302119 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae77308-ed51-47af-8b04-68894226b6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:40.303288 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae77308-ed51-47af-8b04-68894226b6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:40.303796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae77308-ed51-47af-8b04-68894226b6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:40.304276 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae77308-ed51-47af-8b04-68894226b6d7 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:40.307808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae77308-ed51-47af-8b04-68894226b6d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:40.310128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae77308-ed51-47af-8b04-68894226b6d7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:40.312129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 197/392] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:40 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:40.317794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb92fc8-c51d-470d-b56a-c587b3c8248f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:40.328706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb92fc8-c51d-470d-b56a-c587b3c8248f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:40.338612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffae938-42d5-4736-afa7-3101c1f94119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:40.339762 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffae938-42d5-4736-afa7-3101c1f94119 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:40.340249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffae938-42d5-4736-afa7-3101c1f94119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:40.340748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffae938-42d5-4736-afa7-3101c1f94119 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2/groups/62d1d36b55ef431e9c4b80dc4e250723/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:40.344722 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffae938-42d5-4736-afa7-3101c1f94119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4f1a5a685848d5bd703ae910481be2, group_id=62d1d36b55ef431e9c4b80dc4e250723, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:40.347661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffae938-42d5-4736-afa7-3101c1f94119 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:40.383618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 196/393] 10.222.0.79 () {58 vars in 1463 bytes} [Mon Feb 21 01:25:40 2022] PUT /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2/groups/62d1d36b55ef431e9c4b80dc4e250723/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:40.793088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aee28a-3578-4ceb-8c0e-de6491e960f4 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:40.794110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aee28a-3578-4ceb-8c0e-de6491e960f4 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:40.794646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aee28a-3578-4ceb-8c0e-de6491e960f4 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:40.796660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 198/394] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:40.802256 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e6399-4a34-4328-8bb5-e4fba84d37cf None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:40.803079 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e6399-4a34-4328-8bb5-e4fba84d37cf None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:40.803576 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e6399-4a34-4328-8bb5-e4fba84d37cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:40.824961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-ec0e6399-4a34-4328-8bb5-e4fba84d37cf None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:40.826532 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ec0e6399-4a34-4328-8bb5-e4fba84d37cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:40.908040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 197/395] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:40.942673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aee28a-3578-4ceb-8c0e-de6491e960f4 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:40.959726 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aee28a-3578-4ceb-8c0e-de6491e960f4 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:40.964453 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34db73-27cc-4128-9b51-72b8fb4f23ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:40.965467 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34db73-27cc-4128-9b51-72b8fb4f23ed admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:40.965950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34db73-27cc-4128-9b51-72b8fb4f23ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:40.966470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34db73-27cc-4128-9b51-72b8fb4f23ed admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:40.979252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34db73-27cc-4128-9b51-72b8fb4f23ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:40.986558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-5f34db73-27cc-4128-9b51-72b8fb4f23ed admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:40.992521 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 199/396] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:40.993746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e6399-4a34-4328-8bb5-e4fba84d37cf None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:41.003585 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e6399-4a34-4328-8bb5-e4fba84d37cf None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:41.011674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb72d4-4ecd-4fe7-a0b7-745f804eebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:41.012575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb72d4-4ecd-4fe7-a0b7-745f804eebd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:41.013059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb72d4-4ecd-4fe7-a0b7-745f804eebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:41.013567 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb72d4-4ecd-4fe7-a0b7-745f804eebd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:41.014559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb72d4-4ecd-4fe7-a0b7-745f804eebd4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:41.015606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb72d4-4ecd-4fe7-a0b7-745f804eebd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:41.017430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb72d4-4ecd-4fe7-a0b7-745f804eebd4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:41.026569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 198/397] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:41.034252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34db73-27cc-4128-9b51-72b8fb4f23ed admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:41.044916 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34db73-27cc-4128-9b51-72b8fb4f23ed admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:41.054459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec8998-1159-4bf3-a176-f8fe2329c935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:41.055537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec8998-1159-4bf3-a176-f8fe2329c935 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:41.056039 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec8998-1159-4bf3-a176-f8fe2329c935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:41.056512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec8998-1159-4bf3-a176-f8fe2329c935 admin admin] PATH_INFO: `/v3/groups/62d1d36b55ef431e9c4b80dc4e250723` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:41.057907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec8998-1159-4bf3-a176-f8fe2329c935 admin admin] RBAC: Authorizing `identity:get_group(group_id=62d1d36b55ef431e9c4b80dc4e250723)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:41.060106 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec8998-1159-4bf3-a176-f8fe2329c935 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:41.062970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 200/398] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:41 2022] GET /identity/v3/groups/62d1d36b55ef431e9c4b80dc4e250723 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:41.067486 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb72d4-4ecd-4fe7-a0b7-745f804eebd4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:41.078125 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb72d4-4ecd-4fe7-a0b7-745f804eebd4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:41.086374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe7c52-e108-4861-9433-b6dfc35b8a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:41.087531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe7c52-e108-4861-9433-b6dfc35b8a13 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:41.088019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe7c52-e108-4861-9433-b6dfc35b8a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:41.088510 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe7c52-e108-4861-9433-b6dfc35b8a13 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:41.089971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe7c52-e108-4861-9433-b6dfc35b8a13 admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:41.092306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe7c52-e108-4861-9433-b6dfc35b8a13 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:41.095294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 199/399] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:41 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:41.107921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec8998-1159-4bf3-a176-f8fe2329c935 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:41.122756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec8998-1159-4bf3-a176-f8fe2329c935 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:41.130256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17e3d4-e84b-4518-ac84-d6ec4f00ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:41.131133 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17e3d4-e84b-4518-ac84-d6ec4f00ce2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:41.131412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17e3d4-e84b-4518-ac84-d6ec4f00ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:41.131680 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17e3d4-e84b-4518-ac84-d6ec4f00ce2b admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194/groups/62d1d36b55ef431e9c4b80dc4e250723/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:41.139504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17e3d4-e84b-4518-ac84-d6ec4f00ce2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194, group_id=62d1d36b55ef431e9c4b80dc4e250723, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:41.143172 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17e3d4-e84b-4518-ac84-d6ec4f00ce2b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:41.166027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 201/400] 10.222.0.79 () {58 vars in 1463 bytes} [Mon Feb 21 01:25:41 2022] PUT /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194/groups/62d1d36b55ef431e9c4b80dc4e250723/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:25:41.280201 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d64e2-0aa6-4973-9bb4-ed51da4b40ce None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:41.280558 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d64e2-0aa6-4973-9bb4-ed51da4b40ce None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:41.280801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d64e2-0aa6-4973-9bb4-ed51da4b40ce None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:41.282932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 200/401] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:41.288110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb200b-a3e2-4b15-86d2-508201d7bd58 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:41.288619 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb200b-a3e2-4b15-86d2-508201d7bd58 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:41.289085 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb200b-a3e2-4b15-86d2-508201d7bd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:41.315195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-efdb200b-a3e2-4b15-86d2-508201d7bd58 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:41.316671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-efdb200b-a3e2-4b15-86d2-508201d7bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:41.412076 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 202/402] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:41.439485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d64e2-0aa6-4973-9bb4-ed51da4b40ce None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:41.456125 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d64e2-0aa6-4973-9bb4-ed51da4b40ce None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:41.460672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d9245-d823-4698-99e2-4908d82809b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:41.461498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d9245-d823-4698-99e2-4908d82809b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:41.461782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d9245-d823-4698-99e2-4908d82809b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:41.462057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d9245-d823-4698-99e2-4908d82809b6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:41.480400 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d9245-d823-4698-99e2-4908d82809b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:41.487894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-1a0d9245-d823-4698-99e2-4908d82809b6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:41.489404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 201/403] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:41.495865 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb200b-a3e2-4b15-86d2-508201d7bd58 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:41.508594 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb200b-a3e2-4b15-86d2-508201d7bd58 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:41.517540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2497c0-7871-4ea4-b2d2-ca68a72355be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:41.518266 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2497c0-7871-4ea4-b2d2-ca68a72355be admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:41.518555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2497c0-7871-4ea4-b2d2-ca68a72355be admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:41.518835 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2497c0-7871-4ea4-b2d2-ca68a72355be admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:41.519589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2497c0-7871-4ea4-b2d2-ca68a72355be admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:41.519894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2497c0-7871-4ea4-b2d2-ca68a72355be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:41.521513 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2497c0-7871-4ea4-b2d2-ca68a72355be admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:41.533508 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 203/404] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:41.538831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d9245-d823-4698-99e2-4908d82809b6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:41.555460 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d9245-d823-4698-99e2-4908d82809b6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:41.560477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f19ac4-f360-4afe-aea0-76c628ac812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:41.561411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f19ac4-f360-4afe-aea0-76c628ac812a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:41.562332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f19ac4-f360-4afe-aea0-76c628ac812a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:41.562612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f19ac4-f360-4afe-aea0-76c628ac812a admin admin] PATH_INFO: `/v3/groups/62d1d36b55ef431e9c4b80dc4e250723` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:41.564041 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f19ac4-f360-4afe-aea0-76c628ac812a admin admin] RBAC: Authorizing `identity:get_group(group_id=62d1d36b55ef431e9c4b80dc4e250723)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:41.571952 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f19ac4-f360-4afe-aea0-76c628ac812a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:41.573936 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 202/405] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:41 2022] GET /identity/v3/groups/62d1d36b55ef431e9c4b80dc4e250723 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:41.579259 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2497c0-7871-4ea4-b2d2-ca68a72355be admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:41.595252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2497c0-7871-4ea4-b2d2-ca68a72355be admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:41.602335 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9fae-067b-45a3-8768-e47faa0f15d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:41.603197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9fae-067b-45a3-8768-e47faa0f15d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:41.603485 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9fae-067b-45a3-8768-e47faa0f15d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:41.603760 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9fae-067b-45a3-8768-e47faa0f15d1 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:41.610978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa9fae-067b-45a3-8768-e47faa0f15d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:41.613202 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa9fae-067b-45a3-8768-e47faa0f15d1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:41.615348 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 204/406] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:41 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:41.621007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f19ac4-f360-4afe-aea0-76c628ac812a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:41.635865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f19ac4-f360-4afe-aea0-76c628ac812a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:41.641281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe7bda-5ed6-4407-b32d-98469dd9532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:41.642347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe7bda-5ed6-4407-b32d-98469dd9532d admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:41.642630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe7bda-5ed6-4407-b32d-98469dd9532d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:41.642903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe7bda-5ed6-4407-b32d-98469dd9532d admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194/groups/62d1d36b55ef431e9c4b80dc4e250723/roles/289d1250826d4384990c8f3d403bc047` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:41.645360 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe7bda-5ed6-4407-b32d-98469dd9532d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194, group_id=62d1d36b55ef431e9c4b80dc4e250723, role_id=289d1250826d4384990c8f3d403bc047)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:41.648265 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe7bda-5ed6-4407-b32d-98469dd9532d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:41.691627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 203/407] 10.222.0.79 () {58 vars in 1463 bytes} [Mon Feb 21 01:25:41 2022] PUT /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194/groups/62d1d36b55ef431e9c4b80dc4e250723/roles/289d1250826d4384990c8f3d403bc047 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:42.050758 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da361-b5b3-4c65-9706-b0fe642c61b5 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:42.050758 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da361-b5b3-4c65-9706-b0fe642c61b5 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:42.050758 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da361-b5b3-4c65-9706-b0fe642c61b5 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:42.052209 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 205/408] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:42.057581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19795e3e-df6a-4fdb-bfeb-0979ad529e5e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:42.058564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19795e3e-df6a-4fdb-bfeb-0979ad529e5e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:42.059039 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19795e3e-df6a-4fdb-bfeb-0979ad529e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:42.081286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-19795e3e-df6a-4fdb-bfeb-0979ad529e5e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:42.082813 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-19795e3e-df6a-4fdb-bfeb-0979ad529e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:42.165272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 204/409] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:42.195783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0da361-b5b3-4c65-9706-b0fe642c61b5 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:42.214347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0da361-b5b3-4c65-9706-b0fe642c61b5 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:42.221753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d937215-186e-4edc-ac35-01d2fa46e0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:42.222569 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d937215-186e-4edc-ac35-01d2fa46e0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:42.222850 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d937215-186e-4edc-ac35-01d2fa46e0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:42.223120 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d937215-186e-4edc-ac35-01d2fa46e0c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:42.237010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d937215-186e-4edc-ac35-01d2fa46e0c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:42.245604 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-0d937215-186e-4edc-ac35-01d2fa46e0c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:25:42.247169 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 206/410] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:25:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:42.252889 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19795e3e-df6a-4fdb-bfeb-0979ad529e5e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:42.265345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19795e3e-df6a-4fdb-bfeb-0979ad529e5e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:42.270823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424c876-3191-4e47-b6e4-058c8c8fae8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:42.271730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424c876-3191-4e47-b6e4-058c8c8fae8f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:42.272205 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424c876-3191-4e47-b6e4-058c8c8fae8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:42.272689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424c876-3191-4e47-b6e4-058c8c8fae8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:42.273627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424c876-3191-4e47-b6e4-058c8c8fae8f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:42.274138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424c876-3191-4e47-b6e4-058c8c8fae8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:42.275966 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424c876-3191-4e47-b6e4-058c8c8fae8f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:42.288274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 205/411] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:42.293366 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d937215-186e-4edc-ac35-01d2fa46e0c0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:42.304493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d937215-186e-4edc-ac35-01d2fa46e0c0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:42.313840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c4f1e-e6cc-453a-89ed-54c8be9304e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:42.314724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c4f1e-e6cc-453a-89ed-54c8be9304e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:42.315005 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c4f1e-e6cc-453a-89ed-54c8be9304e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:42.315277 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c4f1e-e6cc-453a-89ed-54c8be9304e3 admin admin] PATH_INFO: `/v3/groups/7711a94b6ccf4182805328debc8e4917` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:42.316445 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c4f1e-e6cc-453a-89ed-54c8be9304e3 admin admin] RBAC: Authorizing `identity:get_group(group_id=7711a94b6ccf4182805328debc8e4917)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:42.318390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c4f1e-e6cc-453a-89ed-54c8be9304e3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:42.319979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 207/412] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:42 2022] GET /identity/v3/groups/7711a94b6ccf4182805328debc8e4917 => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:42.325424 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424c876-3191-4e47-b6e4-058c8c8fae8f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:42.339129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424c876-3191-4e47-b6e4-058c8c8fae8f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:42.346756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7d0b4-9a7f-48cf-bb89-c35e837e2011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:42.347865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7d0b4-9a7f-48cf-bb89-c35e837e2011 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:42.348340 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7d0b4-9a7f-48cf-bb89-c35e837e2011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:42.348806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7d0b4-9a7f-48cf-bb89-c35e837e2011 admin admin] PATH_INFO: `/v3/projects/442aa4692fdc4c9cbacda48f2343b2fa` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:42.350898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7d0b4-9a7f-48cf-bb89-c35e837e2011 admin admin] RBAC: Authorizing `identity:get_project(project_id=442aa4692fdc4c9cbacda48f2343b2fa)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:42.352984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7d0b4-9a7f-48cf-bb89-c35e837e2011 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:42.355174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 206/413] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:42 2022] GET /identity/v3/projects/442aa4692fdc4c9cbacda48f2343b2fa => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:42.360967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c4f1e-e6cc-453a-89ed-54c8be9304e3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:42.370816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c4f1e-e6cc-453a-89ed-54c8be9304e3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:42.381755 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924ab1c-2b6d-4538-8fd6-de7238f5c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:42.382656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924ab1c-2b6d-4538-8fd6-de7238f5c7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:42.382937 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924ab1c-2b6d-4538-8fd6-de7238f5c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:42.383206 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924ab1c-2b6d-4538-8fd6-de7238f5c7a0 admin admin] PATH_INFO: `/v3/projects/442aa4692fdc4c9cbacda48f2343b2fa/groups/7711a94b6ccf4182805328debc8e4917/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:42.385149 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924ab1c-2b6d-4538-8fd6-de7238f5c7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=442aa4692fdc4c9cbacda48f2343b2fa, group_id=7711a94b6ccf4182805328debc8e4917, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:42.387828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924ab1c-2b6d-4538-8fd6-de7238f5c7a0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:42.418874 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 208/414] 10.222.0.79 () {58 vars in 1463 bytes} [Mon Feb 21 01:25:42 2022] PUT /identity/v3/projects/442aa4692fdc4c9cbacda48f2343b2fa/groups/7711a94b6ccf4182805328debc8e4917/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:43.401469 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19f3a8-d8c8-4b75-84e2-c47c958fe701 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.402503 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19f3a8-d8c8-4b75-84e2-c47c958fe701 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.403012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19f3a8-d8c8-4b75-84e2-c47c958fe701 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.405250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 207/415] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:43.410990 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ed27d-0535-46ae-bfae-53e5541b8f75 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.411805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ed27d-0535-46ae-bfae-53e5541b8f75 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.412283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ed27d-0535-46ae-bfae-53e5541b8f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.431514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-823ed27d-0535-46ae-bfae-53e5541b8f75 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:43.432991 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-823ed27d-0535-46ae-bfae-53e5541b8f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:43.503862 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 209/416] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:43.551907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19f3a8-d8c8-4b75-84e2-c47c958fe701 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.565252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19f3a8-d8c8-4b75-84e2-c47c958fe701 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.574080 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15761740-2c70-4acb-b821-173344bea4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.575208 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15761740-2c70-4acb-b821-173344bea4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.575695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15761740-2c70-4acb-b821-173344bea4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.576161 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15761740-2c70-4acb-b821-173344bea4b6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.591146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15761740-2c70-4acb-b821-173344bea4b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:43.598703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-15761740-2c70-4acb-b821-173344bea4b6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:43.600109 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 208/417] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:43.605950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ed27d-0535-46ae-bfae-53e5541b8f75 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.615242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ed27d-0535-46ae-bfae-53e5541b8f75 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.621796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32f0c8-7140-4011-97f6-3bc9315f8070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.622710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32f0c8-7140-4011-97f6-3bc9315f8070 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.623186 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32f0c8-7140-4011-97f6-3bc9315f8070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.623634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32f0c8-7140-4011-97f6-3bc9315f8070 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.626453 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db64f-28fe-466b-8d6a-d719d9e3f4a2 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.626936 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db64f-28fe-466b-8d6a-d719d9e3f4a2 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.627386 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db64f-28fe-466b-8d6a-d719d9e3f4a2 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.629327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 209/418] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:43.630121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32f0c8-7140-4011-97f6-3bc9315f8070 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:43.630635 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32f0c8-7140-4011-97f6-3bc9315f8070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:43.632417 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32f0c8-7140-4011-97f6-3bc9315f8070 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:43.635149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb150fe-5603-414d-828a-21596b5378f5 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.635635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb150fe-5603-414d-828a-21596b5378f5 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.636087 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb150fe-5603-414d-828a-21596b5378f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.653290 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 210/419] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:43.658480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32f0c8-7140-4011-97f6-3bc9315f8070 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.660363 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-9bb150fe-5603-414d-828a-21596b5378f5 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:43.661538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9bb150fe-5603-414d-828a-21596b5378f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:43.673828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32f0c8-7140-4011-97f6-3bc9315f8070 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.677502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 210/420] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:43.680926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918eaa5-3f01-4010-9171-746e578e8ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.681837 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918eaa5-3f01-4010-9171-746e578e8ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.682472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918eaa5-3f01-4010-9171-746e578e8ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.682949 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918eaa5-3f01-4010-9171-746e578e8ac4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.693090 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918eaa5-3f01-4010-9171-746e578e8ac4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:43.695244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918eaa5-3f01-4010-9171-746e578e8ac4 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:43.705434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 211/421] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:43.710790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb150fe-5603-414d-828a-21596b5378f5 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.722306 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918eaa5-3f01-4010-9171-746e578e8ac4 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.723040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb150fe-5603-414d-828a-21596b5378f5 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.735663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918eaa5-3f01-4010-9171-746e578e8ac4 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.737125 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de4611-4396-4ec3-b489-24e6d982036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.738240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de4611-4396-4ec3-b489-24e6d982036f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.738727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de4611-4396-4ec3-b489-24e6d982036f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.739197 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de4611-4396-4ec3-b489-24e6d982036f admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.741133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de4611-4396-4ec3-b489-24e6d982036f admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:43.743416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de4611-4396-4ec3-b489-24e6d982036f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:43.745293 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 211/422] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:43.749454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bc4e0-fee4-48a1-b3c1-74f475477cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.750820 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bc4e0-fee4-48a1-b3c1-74f475477cfa admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.751812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de4611-4396-4ec3-b489-24e6d982036f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.752632 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bc4e0-fee4-48a1-b3c1-74f475477cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.753448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bc4e0-fee4-48a1-b3c1-74f475477cfa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.767108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de4611-4396-4ec3-b489-24e6d982036f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.775498 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bc4e0-fee4-48a1-b3c1-74f475477cfa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:43.779471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363384b-697b-4009-b778-0389386756c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.780887 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363384b-697b-4009-b778-0389386756c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.781179 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363384b-697b-4009-b778-0389386756c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.781452 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363384b-697b-4009-b778-0389386756c6 admin admin] PATH_INFO: `/v3/groups/62d1d36b55ef431e9c4b80dc4e250723` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.782670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363384b-697b-4009-b778-0389386756c6 admin admin] RBAC: Authorizing `identity:get_group(group_id=62d1d36b55ef431e9c4b80dc4e250723)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:43.784569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363384b-697b-4009-b778-0389386756c6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:43.784912 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-c20bc4e0-fee4-48a1-b3c1-74f475477cfa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:43.786543 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 212/424] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/groups/62d1d36b55ef431e9c4b80dc4e250723 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:43.786766 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 212/424] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:43.796694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363384b-697b-4009-b778-0389386756c6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.797081 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bc4e0-fee4-48a1-b3c1-74f475477cfa admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.807038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363384b-697b-4009-b778-0389386756c6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.812365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bc4e0-fee4-48a1-b3c1-74f475477cfa admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.819633 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf9bf2-308a-46d1-b15b-f62ec95984a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.820495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a26c9-a1cb-454a-87b4-a79c315a0a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.821987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a26c9-a1cb-454a-87b4-a79c315a0a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.822412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf9bf2-308a-46d1-b15b-f62ec95984a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.822883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a26c9-a1cb-454a-87b4-a79c315a0a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.823395 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf9bf2-308a-46d1-b15b-f62ec95984a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.823856 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a26c9-a1cb-454a-87b4-a79c315a0a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.824355 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf9bf2-308a-46d1-b15b-f62ec95984a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.825562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf9bf2-308a-46d1-b15b-f62ec95984a4 admin admin] RBAC: Adding query filter params (group.id=62d1d36b55ef431e9c4b80dc4e250723, role.id=289d1250826d4384990c8f3d403bc047, scope.project.id=3c4f1a5a685848d5bd703ae910481be2) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:43.826483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a26c9-a1cb-454a-87b4-a79c315a0a96 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:43.826995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a26c9-a1cb-454a-87b4-a79c315a0a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:43.828087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf9bf2-308a-46d1-b15b-f62ec95984a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:43.830249 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf9bf2-308a-46d1-b15b-f62ec95984a4 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:43.832148 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a26c9-a1cb-454a-87b4-a79c315a0a96 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:43.847180 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 213/425] 10.222.0.79 () {56 vars in 1397 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/role_assignments?group.id=62d1d36b55ef431e9c4b80dc4e250723&scope.project.id=3c4f1a5a685848d5bd703ae910481be2&role.id=289d1250826d4384990c8f3d403bc047 => generated 611 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:43.849386 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 213/426] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:43.855185 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf9bf2-308a-46d1-b15b-f62ec95984a4 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.866352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf9bf2-308a-46d1-b15b-f62ec95984a4 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.875017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0995f8-6121-4114-a673-1b0569adb1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.876079 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0995f8-6121-4114-a673-1b0569adb1ac admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.876633 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0995f8-6121-4114-a673-1b0569adb1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.877108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0995f8-6121-4114-a673-1b0569adb1ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.887541 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0995f8-6121-4114-a673-1b0569adb1ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:43.890245 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0995f8-6121-4114-a673-1b0569adb1ac admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:43.903954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 214/427] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:43.910706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a26c9-a1cb-454a-87b4-a79c315a0a96 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.921148 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a26c9-a1cb-454a-87b4-a79c315a0a96 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.927498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb036b-d96b-4508-abb2-7ae559e7d8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.928722 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb036b-d96b-4508-abb2-7ae559e7d8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.929227 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb036b-d96b-4508-abb2-7ae559e7d8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.929697 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb036b-d96b-4508-abb2-7ae559e7d8e8 admin admin] PATH_INFO: `/v3/projects/3c4f1a5a685848d5bd703ae910481be2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.931174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb036b-d96b-4508-abb2-7ae559e7d8e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4f1a5a685848d5bd703ae910481be2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:43.933596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb036b-d96b-4508-abb2-7ae559e7d8e8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:43.936181 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 214/428] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/projects/3c4f1a5a685848d5bd703ae910481be2 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:43.942173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0995f8-6121-4114-a673-1b0569adb1ac admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.951657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0995f8-6121-4114-a673-1b0569adb1ac admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.960799 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb72b95-a289-48ec-8e38-548774e70668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.962053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb72b95-a289-48ec-8e38-548774e70668 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.962581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb72b95-a289-48ec-8e38-548774e70668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.963199 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb72b95-a289-48ec-8e38-548774e70668 admin admin] PATH_INFO: `/v3/groups/62d1d36b55ef431e9c4b80dc4e250723` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.964642 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb72b95-a289-48ec-8e38-548774e70668 admin admin] RBAC: Authorizing `identity:get_group(group_id=62d1d36b55ef431e9c4b80dc4e250723)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:43.966822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb72b95-a289-48ec-8e38-548774e70668 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:43.969578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 215/429] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/groups/62d1d36b55ef431e9c4b80dc4e250723 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:43.975621 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb036b-d96b-4508-abb2-7ae559e7d8e8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.986354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb036b-d96b-4508-abb2-7ae559e7d8e8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.992139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0c4d1-54d3-4f87-a2ed-9872602cd549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.993097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0c4d1-54d3-4f87-a2ed-9872602cd549 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.993632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0c4d1-54d3-4f87-a2ed-9872602cd549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.994123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0c4d1-54d3-4f87-a2ed-9872602cd549 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.995236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0c4d1-54d3-4f87-a2ed-9872602cd549 admin admin] RBAC: Adding query filter params (group.id=62d1d36b55ef431e9c4b80dc4e250723, role.id=3d85c07c87374b898492488d6e608a27, scope.project.id=3c4f1a5a685848d5bd703ae910481be2) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:43.995773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0c4d1-54d3-4f87-a2ed-9872602cd549 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:43.997927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0c4d1-54d3-4f87-a2ed-9872602cd549 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:44.007541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 215/430] 10.222.0.79 () {56 vars in 1397 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/role_assignments?group.id=62d1d36b55ef431e9c4b80dc4e250723&scope.project.id=3c4f1a5a685848d5bd703ae910481be2&role.id=3d85c07c87374b898492488d6e608a27 => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:44.271148 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023be047-f118-4a6c-b70f-c5978e0c46b0 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:44.271814 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023be047-f118-4a6c-b70f-c5978e0c46b0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:44.272303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023be047-f118-4a6c-b70f-c5978e0c46b0 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:44.274579 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 216/431] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:44.279766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc7371-efae-4c6e-9fe6-0ccfd1f86471 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:44.280866 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc7371-efae-4c6e-9fe6-0ccfd1f86471 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:44.281335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc7371-efae-4c6e-9fe6-0ccfd1f86471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:44.305193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-bcbc7371-efae-4c6e-9fe6-0ccfd1f86471 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:44.306745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-bcbc7371-efae-4c6e-9fe6-0ccfd1f86471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:44.315308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 216/432] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:44.341689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023be047-f118-4a6c-b70f-c5978e0c46b0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:44.357268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023be047-f118-4a6c-b70f-c5978e0c46b0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:44.361913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cf2f7-2dfc-4b88-a24a-77c6ab446e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:44.362720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cf2f7-2dfc-4b88-a24a-77c6ab446e32 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:44.362997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cf2f7-2dfc-4b88-a24a-77c6ab446e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:44.363264 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cf2f7-2dfc-4b88-a24a-77c6ab446e32 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:44.376993 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cf2f7-2dfc-4b88-a24a-77c6ab446e32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:44.384036 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-831cf2f7-2dfc-4b88-a24a-77c6ab446e32 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:25:44.385226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 217/433] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:44.391726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc7371-efae-4c6e-9fe6-0ccfd1f86471 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:44.400803 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc7371-efae-4c6e-9fe6-0ccfd1f86471 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:44.406906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1789f-1618-4e1c-921f-a0cd308731a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:44.407561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1789f-1618-4e1c-921f-a0cd308731a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:44.407840 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1789f-1618-4e1c-921f-a0cd308731a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:44.408164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1789f-1618-4e1c-921f-a0cd308731a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:44.408920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1789f-1618-4e1c-921f-a0cd308731a7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:44.409241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1789f-1618-4e1c-921f-a0cd308731a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:44.410857 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1789f-1618-4e1c-921f-a0cd308731a7 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:44.422520 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 217/434] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:25:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:44.427730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cf2f7-2dfc-4b88-a24a-77c6ab446e32 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:44.438670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cf2f7-2dfc-4b88-a24a-77c6ab446e32 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:44.444371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08933ea5-36e5-42f7-94ea-1e4bdb3452cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:44.445064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08933ea5-36e5-42f7-94ea-1e4bdb3452cd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:44.445392 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08933ea5-36e5-42f7-94ea-1e4bdb3452cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:44.445660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08933ea5-36e5-42f7-94ea-1e4bdb3452cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:44.454354 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08933ea5-36e5-42f7-94ea-1e4bdb3452cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:44.456052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08933ea5-36e5-42f7-94ea-1e4bdb3452cd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:44.465182 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 218/435] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:44.471003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1789f-1618-4e1c-921f-a0cd308731a7 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:44.480796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1789f-1618-4e1c-921f-a0cd308731a7 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:44.488736 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6559a-a918-4ffd-98da-0e0a68adf133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:44.489705 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6559a-a918-4ffd-98da-0e0a68adf133 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:44.490059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6559a-a918-4ffd-98da-0e0a68adf133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:44.490440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6559a-a918-4ffd-98da-0e0a68adf133 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:44.491802 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6559a-a918-4ffd-98da-0e0a68adf133 admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:44.493995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6559a-a918-4ffd-98da-0e0a68adf133 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:44.495903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 218/436] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:44 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:44.502351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08933ea5-36e5-42f7-94ea-1e4bdb3452cd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:44.512107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08933ea5-36e5-42f7-94ea-1e4bdb3452cd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:44.517591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd37d4-b038-4197-8d4e-3952050ed059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:44.518504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd37d4-b038-4197-8d4e-3952050ed059 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:44.518788 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd37d4-b038-4197-8d4e-3952050ed059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:44.519063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd37d4-b038-4197-8d4e-3952050ed059 admin admin] PATH_INFO: `/v3/groups/62d1d36b55ef431e9c4b80dc4e250723` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:44.520375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd37d4-b038-4197-8d4e-3952050ed059 admin admin] RBAC: Authorizing `identity:get_group(group_id=62d1d36b55ef431e9c4b80dc4e250723)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:44.522445 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd37d4-b038-4197-8d4e-3952050ed059 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:44.524454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 219/437] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:44 2022] GET /identity/v3/groups/62d1d36b55ef431e9c4b80dc4e250723 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:44.531704 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6559a-a918-4ffd-98da-0e0a68adf133 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:44.543301 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6559a-a918-4ffd-98da-0e0a68adf133 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:44.548362 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1f4ba-05db-4ee0-884a-78de2e924239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:44.549458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f4ba-05db-4ee0-884a-78de2e924239 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:44.549946 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f4ba-05db-4ee0-884a-78de2e924239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:44.550603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f4ba-05db-4ee0-884a-78de2e924239 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:44.551575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1f4ba-05db-4ee0-884a-78de2e924239 admin admin] RBAC: Adding query filter params (group.id=62d1d36b55ef431e9c4b80dc4e250723, role.id=3d85c07c87374b898492488d6e608a27, scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:44.552111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1f4ba-05db-4ee0-884a-78de2e924239 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:44.554225 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1f4ba-05db-4ee0-884a-78de2e924239 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:44.560927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 219/438] 10.222.0.79 () {56 vars in 1397 bytes} [Mon Feb 21 01:25:44 2022] GET /identity/v3/role_assignments?group.id=62d1d36b55ef431e9c4b80dc4e250723&scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194&role.id=3d85c07c87374b898492488d6e608a27 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:44.868947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcb7ff-8132-441b-af7b-e49b472359a4 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:44.869290 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcb7ff-8132-441b-af7b-e49b472359a4 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:44.869480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcb7ff-8132-441b-af7b-e49b472359a4 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:44.871405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 220/439] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:44.877419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf84432-d173-4213-86f2-2f4b5edcc3f4 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:44.877773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf84432-d173-4213-86f2-2f4b5edcc3f4 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:44.878054 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf84432-d173-4213-86f2-2f4b5edcc3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:44.897284 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-3cf84432-d173-4213-86f2-2f4b5edcc3f4 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:44.898487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3cf84432-d173-4213-86f2-2f4b5edcc3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:44.906102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 220/440] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:44.930229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcb7ff-8132-441b-af7b-e49b472359a4 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:44.943296 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcb7ff-8132-441b-af7b-e49b472359a4 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:44.947575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc635d-da3d-407c-a6c2-ce3f8ae4d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:44.948369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc635d-da3d-407c-a6c2-ce3f8ae4d11c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:44.948651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc635d-da3d-407c-a6c2-ce3f8ae4d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:44.948919 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc635d-da3d-407c-a6c2-ce3f8ae4d11c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:44.960273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc635d-da3d-407c-a6c2-ce3f8ae4d11c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:44.967532 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-d1cc635d-da3d-407c-a6c2-ce3f8ae4d11c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:44.970285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 221/441] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:44.974902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf84432-d173-4213-86f2-2f4b5edcc3f4 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:44.983997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf84432-d173-4213-86f2-2f4b5edcc3f4 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:44.989827 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f665e-e4ad-43a0-972a-6d18e2a448cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:44.990552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f665e-e4ad-43a0-972a-6d18e2a448cf admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:44.990834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f665e-e4ad-43a0-972a-6d18e2a448cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:44.991107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f665e-e4ad-43a0-972a-6d18e2a448cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:44.991863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f665e-e4ad-43a0-972a-6d18e2a448cf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:44.992174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f665e-e4ad-43a0-972a-6d18e2a448cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:44.993778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f665e-e4ad-43a0-972a-6d18e2a448cf admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:45.003340 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 221/442] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:45.008610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc635d-da3d-407c-a6c2-ce3f8ae4d11c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:45.019581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc635d-da3d-407c-a6c2-ce3f8ae4d11c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:45.024124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2ecc9-834f-48ff-aac0-a03053e43c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:45.024789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2ecc9-834f-48ff-aac0-a03053e43c26 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:45.025078 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2ecc9-834f-48ff-aac0-a03053e43c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:45.025355 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2ecc9-834f-48ff-aac0-a03053e43c26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:45.035105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2ecc9-834f-48ff-aac0-a03053e43c26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:45.036929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2ecc9-834f-48ff-aac0-a03053e43c26 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:45.046899 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 222/443] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:45.052656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f665e-e4ad-43a0-972a-6d18e2a448cf admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:45.063198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f665e-e4ad-43a0-972a-6d18e2a448cf admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:45.067754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278294a-3a26-4316-82b7-129c40aef390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:45.068606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278294a-3a26-4316-82b7-129c40aef390 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:45.068890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278294a-3a26-4316-82b7-129c40aef390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:45.069164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278294a-3a26-4316-82b7-129c40aef390 admin admin] PATH_INFO: `/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:45.070372 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278294a-3a26-4316-82b7-129c40aef390 admin admin] RBAC: Authorizing `identity:get_project(project_id=73ee7541f8f24b6dbf8c7a5bebe8d194)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:45.072521 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278294a-3a26-4316-82b7-129c40aef390 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:45.074752 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 222/444] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:45 2022] GET /identity/v3/projects/73ee7541f8f24b6dbf8c7a5bebe8d194 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:45.080559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2ecc9-834f-48ff-aac0-a03053e43c26 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:45.090474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2ecc9-834f-48ff-aac0-a03053e43c26 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:45.097756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889529e-9fe8-442f-80f7-aadb6bc7a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:45.098638 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889529e-9fe8-442f-80f7-aadb6bc7a0cd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:45.098923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889529e-9fe8-442f-80f7-aadb6bc7a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:45.099200 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889529e-9fe8-442f-80f7-aadb6bc7a0cd admin admin] PATH_INFO: `/v3/groups/62d1d36b55ef431e9c4b80dc4e250723` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:45.100377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889529e-9fe8-442f-80f7-aadb6bc7a0cd admin admin] RBAC: Authorizing `identity:get_group(group_id=62d1d36b55ef431e9c4b80dc4e250723)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:45.102332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889529e-9fe8-442f-80f7-aadb6bc7a0cd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:45.104254 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 223/445] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:45 2022] GET /identity/v3/groups/62d1d36b55ef431e9c4b80dc4e250723 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:45.110288 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278294a-3a26-4316-82b7-129c40aef390 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:45.123748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278294a-3a26-4316-82b7-129c40aef390 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:45.129987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e6ff9-736c-4547-a0d7-011bf03e1c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:45.130719 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e6ff9-736c-4547-a0d7-011bf03e1c18 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:45.131124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e6ff9-736c-4547-a0d7-011bf03e1c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:45.131408 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e6ff9-736c-4547-a0d7-011bf03e1c18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:45.132255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e6ff9-736c-4547-a0d7-011bf03e1c18 admin admin] RBAC: Adding query filter params (group.id=62d1d36b55ef431e9c4b80dc4e250723, role.id=289d1250826d4384990c8f3d403bc047, scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:45.132571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e6ff9-736c-4547-a0d7-011bf03e1c18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:45.134461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e6ff9-736c-4547-a0d7-011bf03e1c18 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:45.142004 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 223/446] 10.222.0.79 () {56 vars in 1397 bytes} [Mon Feb 21 01:25:45 2022] GET /identity/v3/role_assignments?group.id=62d1d36b55ef431e9c4b80dc4e250723&scope.project.id=73ee7541f8f24b6dbf8c7a5bebe8d194&role.id=289d1250826d4384990c8f3d403bc047 => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:45.406481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569c922-14cd-4608-a9af-bc19d3eaadbf None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:45.406694 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569c922-14cd-4608-a9af-bc19d3eaadbf None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:45.406968 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569c922-14cd-4608-a9af-bc19d3eaadbf None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:45.408739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 224/447] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:45.414431 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1787a-f178-419c-ac6c-4519767e3ccc None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:45.414873 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1787a-f178-419c-ac6c-4519767e3ccc None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:45.414960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1787a-f178-419c-ac6c-4519767e3ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:45.433367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-90c1787a-f178-419c-ac6c-4519767e3ccc None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:45.434580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-90c1787a-f178-419c-ac6c-4519767e3ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:45.442820 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 224/448] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:45.466589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569c922-14cd-4608-a9af-bc19d3eaadbf None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:45.478663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569c922-14cd-4608-a9af-bc19d3eaadbf None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:45.482972 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4d5c3-c073-4cf3-8e69-fba7e99c6807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:45.484277 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4d5c3-c073-4cf3-8e69-fba7e99c6807 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:45.484557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4d5c3-c073-4cf3-8e69-fba7e99c6807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:45.484829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4d5c3-c073-4cf3-8e69-fba7e99c6807 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:45.494920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4d5c3-c073-4cf3-8e69-fba7e99c6807 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:45.502582 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-27a4d5c3-c073-4cf3-8e69-fba7e99c6807 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:25:45.503769 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 225/449] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:25:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:45.509651 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1787a-f178-419c-ac6c-4519767e3ccc None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:45.518545 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1787a-f178-419c-ac6c-4519767e3ccc None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:45.522865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4ac02-444e-4dd2-ad60-e073b3ea9d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:45.523514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4ac02-444e-4dd2-ad60-e073b3ea9d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:45.523794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4ac02-444e-4dd2-ad60-e073b3ea9d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:45.524069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4ac02-444e-4dd2-ad60-e073b3ea9d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:45.524812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4ac02-444e-4dd2-ad60-e073b3ea9d4b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:45.525117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4ac02-444e-4dd2-ad60-e073b3ea9d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:45.526737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4ac02-444e-4dd2-ad60-e073b3ea9d4b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:45.534670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 225/450] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:45.539898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4d5c3-c073-4cf3-8e69-fba7e99c6807 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:45.549829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4d5c3-c073-4cf3-8e69-fba7e99c6807 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:45.554042 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c10d3-1147-453f-bb95-339b2eac4404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:45.554685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c10d3-1147-453f-bb95-339b2eac4404 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:45.554966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c10d3-1147-453f-bb95-339b2eac4404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:45.555238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c10d3-1147-453f-bb95-339b2eac4404 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:45.563849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c10d3-1147-453f-bb95-339b2eac4404 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:45.565656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c10d3-1147-453f-bb95-339b2eac4404 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:45.574368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 226/451] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:45.579471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4ac02-444e-4dd2-ad60-e073b3ea9d4b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:45.588815 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4ac02-444e-4dd2-ad60-e073b3ea9d4b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:45.593080 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c81c7-ce1d-4e01-bc43-56c68436d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:45.593908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c81c7-ce1d-4e01-bc43-56c68436d07a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:45.594190 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c81c7-ce1d-4e01-bc43-56c68436d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:45.594500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c81c7-ce1d-4e01-bc43-56c68436d07a admin admin] PATH_INFO: `/v3/projects/442aa4692fdc4c9cbacda48f2343b2fa` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:45.595739 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c81c7-ce1d-4e01-bc43-56c68436d07a admin admin] RBAC: Authorizing `identity:get_project(project_id=442aa4692fdc4c9cbacda48f2343b2fa)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:45.597503 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c81c7-ce1d-4e01-bc43-56c68436d07a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:45.599158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 226/452] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:25:45 2022] GET /identity/v3/projects/442aa4692fdc4c9cbacda48f2343b2fa => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:45.603864 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c10d3-1147-453f-bb95-339b2eac4404 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:45.612556 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c10d3-1147-453f-bb95-339b2eac4404 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:45.616767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86def673-5705-4eb5-827b-0dc4457ec53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:45.617555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def673-5705-4eb5-827b-0dc4457ec53c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:45.617832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def673-5705-4eb5-827b-0dc4457ec53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:45.618101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def673-5705-4eb5-827b-0dc4457ec53c admin admin] PATH_INFO: `/v3/groups/7711a94b6ccf4182805328debc8e4917` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:45.619286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86def673-5705-4eb5-827b-0dc4457ec53c admin admin] RBAC: Authorizing `identity:get_group(group_id=7711a94b6ccf4182805328debc8e4917)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:45.621137 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86def673-5705-4eb5-827b-0dc4457ec53c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:45.622663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 227/453] 10.222.0.79 () {56 vars in 1201 bytes} [Mon Feb 21 01:25:45 2022] GET /identity/v3/groups/7711a94b6ccf4182805328debc8e4917 => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:45.628782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c81c7-ce1d-4e01-bc43-56c68436d07a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:45.637765 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c81c7-ce1d-4e01-bc43-56c68436d07a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:45.642066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d646d6-10fb-4209-9cbb-1d546f32a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:45.642784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d646d6-10fb-4209-9cbb-1d546f32a0ad admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:45.643067 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d646d6-10fb-4209-9cbb-1d546f32a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:45.643344 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d646d6-10fb-4209-9cbb-1d546f32a0ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:45.644153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d646d6-10fb-4209-9cbb-1d546f32a0ad admin admin] RBAC: Adding query filter params (group.id=7711a94b6ccf4182805328debc8e4917, role.id=548abad662724741a3261205ee7cb828, scope.project.id=442aa4692fdc4c9cbacda48f2343b2fa) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:45.644463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d646d6-10fb-4209-9cbb-1d546f32a0ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:45.646399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d646d6-10fb-4209-9cbb-1d546f32a0ad admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:45.651898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 227/454] 10.222.0.79 () {56 vars in 1397 bytes} [Mon Feb 21 01:25:45 2022] GET /identity/v3/role_assignments?group.id=7711a94b6ccf4182805328debc8e4917&scope.project.id=442aa4692fdc4c9cbacda48f2343b2fa&role.id=548abad662724741a3261205ee7cb828 => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:48.510849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b63a46-ccd1-4717-8b15-c41f683dd033 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.511363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b63a46-ccd1-4717-8b15-c41f683dd033 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.511437 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b63a46-ccd1-4717-8b15-c41f683dd033 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.513401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 228/455] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:48.519773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76881f4-567e-4585-a494-e0dc745df8c6 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.520617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76881f4-567e-4585-a494-e0dc745df8c6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.521107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76881f4-567e-4585-a494-e0dc745df8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.545172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e76881f4-567e-4585-a494-e0dc745df8c6 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:48.550521 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e76881f4-567e-4585-a494-e0dc745df8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:48.558600 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 228/456] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:48.599374 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b63a46-ccd1-4717-8b15-c41f683dd033 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:48.605742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8f7e7-5dad-40d1-a745-df4c5e0f31ee None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.606014 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8f7e7-5dad-40d1-a745-df4c5e0f31ee None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.606302 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8f7e7-5dad-40d1-a745-df4c5e0f31ee None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.608305 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 229/457] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:48.614836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d253b-14d3-4b2f-aed0-bc0a164583e6 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.615333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d253b-14d3-4b2f-aed0-bc0a164583e6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.615762 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d253b-14d3-4b2f-aed0-bc0a164583e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.620402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b63a46-ccd1-4717-8b15-c41f683dd033 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:48.636899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-616d253b-14d3-4b2f-aed0-bc0a164583e6 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:48.638391 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-616d253b-14d3-4b2f-aed0-bc0a164583e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:48.640788 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83335166-39aa-4473-8791-386f2684a68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:48.641574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83335166-39aa-4473-8791-386f2684a68b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.642095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83335166-39aa-4473-8791-386f2684a68b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.642597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83335166-39aa-4473-8791-386f2684a68b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.653290 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83335166-39aa-4473-8791-386f2684a68b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:48.655468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83335166-39aa-4473-8791-386f2684a68b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:48.662224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 230/458] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:48.674294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-83335166-39aa-4473-8791-386f2684a68b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:48.675674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 229/459] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:48.681512 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d253b-14d3-4b2f-aed0-bc0a164583e6 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:48.691413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d253b-14d3-4b2f-aed0-bc0a164583e6 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:48.692891 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83335166-39aa-4473-8791-386f2684a68b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:48.703006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791addd-f573-4248-a954-d9fd4b73a2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:48.703675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791addd-f573-4248-a954-d9fd4b73a2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.703953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791addd-f573-4248-a954-d9fd4b73a2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.704221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791addd-f573-4248-a954-d9fd4b73a2a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.704949 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791addd-f573-4248-a954-d9fd4b73a2a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:48.705251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791addd-f573-4248-a954-d9fd4b73a2a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:48.706277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-5791addd-f573-4248-a954-d9fd4b73a2a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:48.706277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:25:48.706277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:25:48.707167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791addd-f573-4248-a954-d9fd4b73a2a0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:48.712176 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83335166-39aa-4473-8791-386f2684a68b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:48.726281 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf07033-eb9f-4882-8bda-b415b035a28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:48.727069 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf07033-eb9f-4882-8bda-b415b035a28e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.727346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf07033-eb9f-4882-8bda-b415b035a28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.727615 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf07033-eb9f-4882-8bda-b415b035a28e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.738059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 231/460] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:48.744185 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf07033-eb9f-4882-8bda-b415b035a28e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:48.746256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf07033-eb9f-4882-8bda-b415b035a28e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:48.747302 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791addd-f573-4248-a954-d9fd4b73a2a0 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:48.764665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791addd-f573-4248-a954-d9fd4b73a2a0 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:48.777607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-dcf07033-eb9f-4882-8bda-b415b035a28e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:48.779617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61737f31-29a7-4469-b3a6-7b9ec9e2851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:48.781035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61737f31-29a7-4469-b3a6-7b9ec9e2851c admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.781524 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 230/461] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:48.781732 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61737f31-29a7-4469-b3a6-7b9ec9e2851c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.782227 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61737f31-29a7-4469-b3a6-7b9ec9e2851c admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.782867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571793-7703-4d3d-8f60-94a1e0a8c64d None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.783154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571793-7703-4d3d-8f60-94a1e0a8c64d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.783428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571793-7703-4d3d-8f60-94a1e0a8c64d None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.783738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61737f31-29a7-4469-b3a6-7b9ec9e2851c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:48.785083 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 231/462] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:48.786052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61737f31-29a7-4469-b3a6-7b9ec9e2851c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:48.792297 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571793-7703-4d3d-8f60-94a1e0a8c64d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:48.808358 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571793-7703-4d3d-8f60-94a1e0a8c64d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:48.813570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735c5b3-c5e1-40bf-9c3c-7af948a1dd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:48.814676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735c5b3-c5e1-40bf-9c3c-7af948a1dd5a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.815219 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735c5b3-c5e1-40bf-9c3c-7af948a1dd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.815689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735c5b3-c5e1-40bf-9c3c-7af948a1dd5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.816761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735c5b3-c5e1-40bf-9c3c-7af948a1dd5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:48.817286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735c5b3-c5e1-40bf-9c3c-7af948a1dd5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:48.818415 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 232/463] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:25:48 2022] POST /identity/v3/users => generated 248 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:48.819608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735c5b3-c5e1-40bf-9c3c-7af948a1dd5a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:48.819975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df3814-46f4-4220-8866-642de83942e1 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.820264 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df3814-46f4-4220-8866-642de83942e1 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.820538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df3814-46f4-4220-8866-642de83942e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.834976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 232/464] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:48.850596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735c5b3-c5e1-40bf-9c3c-7af948a1dd5a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:48.855336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f7df3814-46f4-4220-8866-642de83942e1 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:48.856538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f7df3814-46f4-4220-8866-642de83942e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:48.867315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735c5b3-c5e1-40bf-9c3c-7af948a1dd5a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:48.871902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3457-8e1b-40d3-b694-bd7577101159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:48.872580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3457-8e1b-40d3-b694-bd7577101159 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.872863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3457-8e1b-40d3-b694-bd7577101159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.873138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3457-8e1b-40d3-b694-bd7577101159 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.873885 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd3457-8e1b-40d3-b694-bd7577101159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:48.875224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-f1fd3457-8e1b-40d3-b694-bd7577101159 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:48.875224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:25:48.875224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:25:48.876423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd3457-8e1b-40d3-b694-bd7577101159 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:48.892295 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 233/465] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:48.910324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 233/466] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:25:48 2022] POST /identity/v3/users => generated 248 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:25:48.930514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df3814-46f4-4220-8866-642de83942e1 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:48.948187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df3814-46f4-4220-8866-642de83942e1 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:48.963833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f95e1d-573b-4e38-b32a-c95588509223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:48.964676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f95e1d-573b-4e38-b32a-c95588509223 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.964960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f95e1d-573b-4e38-b32a-c95588509223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.965236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f95e1d-573b-4e38-b32a-c95588509223 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.985214 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f95e1d-573b-4e38-b32a-c95588509223 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:48.987188 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f95e1d-573b-4e38-b32a-c95588509223 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:49.009402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-84f95e1d-573b-4e38-b32a-c95588509223 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:49.010730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 234/467] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:49.017603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3457-8e1b-40d3-b694-bd7577101159 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:49.028377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3457-8e1b-40d3-b694-bd7577101159 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:49.046315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690843ab-4f75-43d0-beac-f97a19c6a408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:49.047012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690843ab-4f75-43d0-beac-f97a19c6a408 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:49.047295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690843ab-4f75-43d0-beac-f97a19c6a408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:49.047567 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690843ab-4f75-43d0-beac-f97a19c6a408 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:49.048317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690843ab-4f75-43d0-beac-f97a19c6a408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:49.048622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690843ab-4f75-43d0-beac-f97a19c6a408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:49.050291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690843ab-4f75-43d0-beac-f97a19c6a408 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:49.063962 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 234/468] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:49.069583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f95e1d-573b-4e38-b32a-c95588509223 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:49.081458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f95e1d-573b-4e38-b32a-c95588509223 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:49.100906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5061443-6bca-4f21-8f41-965e665284c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:49.101693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5061443-6bca-4f21-8f41-965e665284c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:49.101980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5061443-6bca-4f21-8f41-965e665284c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:49.102281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5061443-6bca-4f21-8f41-965e665284c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:49.103012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5061443-6bca-4f21-8f41-965e665284c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:49.104985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5061443-6bca-4f21-8f41-965e665284c1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:49.143160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 235/469] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:25:49 2022] POST /identity/v3/users => generated 246 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:49.216278 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab28cb-5444-49fc-86f5-31bd3e6ef9c4 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:49.216714 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab28cb-5444-49fc-86f5-31bd3e6ef9c4 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:49.216928 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab28cb-5444-49fc-86f5-31bd3e6ef9c4 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:49.219733 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 235/470] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:49.225596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005156f5-cba6-4419-bc36-28aa776270b9 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:49.226237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005156f5-cba6-4419-bc36-28aa776270b9 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:49.226815 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005156f5-cba6-4419-bc36-28aa776270b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:49.248575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-005156f5-cba6-4419-bc36-28aa776270b9 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:49.250106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-005156f5-cba6-4419-bc36-28aa776270b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:49.262862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 236/471] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:49.288962 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab28cb-5444-49fc-86f5-31bd3e6ef9c4 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:49.302735 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab28cb-5444-49fc-86f5-31bd3e6ef9c4 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:49.308634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1d1b4-f952-4ff4-836b-833e321ed6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:49.309723 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1d1b4-f952-4ff4-836b-833e321ed6cd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:49.310242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1d1b4-f952-4ff4-836b-833e321ed6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:49.310709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1d1b4-f952-4ff4-836b-833e321ed6cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:49.324741 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1d1b4-f952-4ff4-836b-833e321ed6cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:49.327576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1d1b4-f952-4ff4-836b-833e321ed6cd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:49.346107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-b8d1d1b4-f952-4ff4-836b-833e321ed6cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:49.348038 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 236/472] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:49.353370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005156f5-cba6-4419-bc36-28aa776270b9 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:49.364035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005156f5-cba6-4419-bc36-28aa776270b9 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:49.369311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb1be4-1ef9-4834-99bf-0242fce11755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:49.370051 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb1be4-1ef9-4834-99bf-0242fce11755 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:49.370435 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb1be4-1ef9-4834-99bf-0242fce11755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:49.370784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb1be4-1ef9-4834-99bf-0242fce11755 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:49.371610 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb1be4-1ef9-4834-99bf-0242fce11755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:49.371985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb1be4-1ef9-4834-99bf-0242fce11755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:49.373681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb1be4-1ef9-4834-99bf-0242fce11755 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:49.387622 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 237/473] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:49.393100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1d1b4-f952-4ff4-836b-833e321ed6cd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:49.403087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1d1b4-f952-4ff4-836b-833e321ed6cd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:49.408293 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e10b2-e3a7-4b47-9924-bf68bd18c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:49.408998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e10b2-e3a7-4b47-9924-bf68bd18c864 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:49.409371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e10b2-e3a7-4b47-9924-bf68bd18c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:49.409725 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e10b2-e3a7-4b47-9924-bf68bd18c864 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:49.410561 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e10b2-e3a7-4b47-9924-bf68bd18c864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:49.412559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e10b2-e3a7-4b47-9924-bf68bd18c864 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:49.437206 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 237/474] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:25:49 2022] POST /identity/v3/users => generated 249 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:49.910723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e8ee2-fb32-428d-ba28-545d2e3cd930 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:49.911713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e8ee2-fb32-428d-ba28-545d2e3cd930 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:49.912193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e8ee2-fb32-428d-ba28-545d2e3cd930 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:49.914447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 238/475] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:49.919386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae95e-df30-4642-a96f-ce6c6cfe3237 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:49.919813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae95e-df30-4642-a96f-ce6c6cfe3237 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:49.919927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae95e-df30-4642-a96f-ce6c6cfe3237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:49.947634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-890ae95e-df30-4642-a96f-ce6c6cfe3237 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:49.949072 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-890ae95e-df30-4642-a96f-ce6c6cfe3237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:49.961283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 238/476] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:50.005355 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e8ee2-fb32-428d-ba28-545d2e3cd930 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:50.020409 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e8ee2-fb32-428d-ba28-545d2e3cd930 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:50.028105 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e8f2-203d-48bd-8b63-9e93172f2992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:50.028780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e8f2-203d-48bd-8b63-9e93172f2992 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:50.029057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e8f2-203d-48bd-8b63-9e93172f2992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:50.029329 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e8f2-203d-48bd-8b63-9e93172f2992 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:50.030123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88e8f2-203d-48bd-8b63-9e93172f2992 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:50.032269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88e8f2-203d-48bd-8b63-9e93172f2992 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:50.047474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.sql.core [None req-cd88e8f2-203d-48bd-8b63-9e93172f2992 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 21 01:25:50.047474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 21 01:25:50.047474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [parameters: {'id': '056856ff6925422196822c108bd3ab6d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 21 01:25:50.047474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79371) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 01:25:50.061876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-cd88e8f2-203d-48bd-8b63-9e93172f2992 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 21 01:25:50.067615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 239/477] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:25:50 2022] POST /identity/v3/roles => generated 144 bytes in 63 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:50.073279 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ae95e-df30-4642-a96f-ce6c6cfe3237 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:50.087307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ae95e-df30-4642-a96f-ce6c6cfe3237 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:50.115907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cbb49-8440-4b6b-912d-c314e8b97fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:50.116974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cbb49-8440-4b6b-912d-c314e8b97fbf admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:50.117427 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cbb49-8440-4b6b-912d-c314e8b97fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:50.117871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cbb49-8440-4b6b-912d-c314e8b97fbf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:50.142088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cbb49-8440-4b6b-912d-c314e8b97fbf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:50.153554 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-d43cbb49-8440-4b6b-912d-c314e8b97fbf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:25:50.155305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 239/478] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:25:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:50.161095 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e8f2-203d-48bd-8b63-9e93172f2992 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:50.181397 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e8f2-203d-48bd-8b63-9e93172f2992 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:50.185954 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a424ef2-f338-42a9-ae78-0614370e8a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:50.187205 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a424ef2-f338-42a9-ae78-0614370e8a64 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:50.187490 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a424ef2-f338-42a9-ae78-0614370e8a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:50.187767 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a424ef2-f338-42a9-ae78-0614370e8a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:50.188517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a424ef2-f338-42a9-ae78-0614370e8a64 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:50.188823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a424ef2-f338-42a9-ae78-0614370e8a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:50.190464 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a424ef2-f338-42a9-ae78-0614370e8a64 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:50.207680 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 240/479] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:51.583712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab16e95-9ecd-48f9-8afa-1bac89df9f74 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.584718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab16e95-9ecd-48f9-8afa-1bac89df9f74 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.585203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab16e95-9ecd-48f9-8afa-1bac89df9f74 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.587178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 240/480] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:51.592636 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79720f-8d35-4617-bc5f-21d4899df240 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.593406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79720f-8d35-4617-bc5f-21d4899df240 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.593406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79720f-8d35-4617-bc5f-21d4899df240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.615273 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-cd79720f-8d35-4617-bc5f-21d4899df240 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:51.616467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-cd79720f-8d35-4617-bc5f-21d4899df240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:51.629055 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 241/481] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:51.673351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab16e95-9ecd-48f9-8afa-1bac89df9f74 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:51.691832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab16e95-9ecd-48f9-8afa-1bac89df9f74 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:51.696361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548880be-a1f8-4f06-9c75-5b2d7519592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:51.697144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548880be-a1f8-4f06-9c75-5b2d7519592e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.697424 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548880be-a1f8-4f06-9c75-5b2d7519592e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.697695 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548880be-a1f8-4f06-9c75-5b2d7519592e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.715615 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548880be-a1f8-4f06-9c75-5b2d7519592e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:51.722692 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-548880be-a1f8-4f06-9c75-5b2d7519592e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:25:51.724238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 241/482] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:51.729505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79720f-8d35-4617-bc5f-21d4899df240 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:51.731867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eef7db-d950-4b49-875d-ba23fef30ee1 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.732358 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eef7db-d950-4b49-875d-ba23fef30ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.732805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eef7db-d950-4b49-875d-ba23fef30ee1 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.735017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 242/483] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:51.740159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f58c-0011-471d-9e56-11f2367d6c57 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.740608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f58c-0011-471d-9e56-11f2367d6c57 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.741023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f58c-0011-471d-9e56-11f2367d6c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.749271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79720f-8d35-4617-bc5f-21d4899df240 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:51.760599 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-52d8f58c-0011-471d-9e56-11f2367d6c57 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:51.761971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-52d8f58c-0011-471d-9e56-11f2367d6c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:51.763736 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f4457-71e9-4f3b-8217-6ffbd1d40944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:51.764471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f4457-71e9-4f3b-8217-6ffbd1d40944 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.765259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f4457-71e9-4f3b-8217-6ffbd1d40944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.765534 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f4457-71e9-4f3b-8217-6ffbd1d40944 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.766316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f4457-71e9-4f3b-8217-6ffbd1d40944 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:51.766635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f4457-71e9-4f3b-8217-6ffbd1d40944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:51.768266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f4457-71e9-4f3b-8217-6ffbd1d40944 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:51.771899 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 243/484] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:51.789628 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 242/485] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:25:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:51.794968 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8f58c-0011-471d-9e56-11f2367d6c57 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:51.801648 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f4457-71e9-4f3b-8217-6ffbd1d40944 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:51.805402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8f58c-0011-471d-9e56-11f2367d6c57 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:51.810068 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058b6c3-dd8c-431e-ab27-5d2d7be79ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:51.811112 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058b6c3-dd8c-431e-ab27-5d2d7be79ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.812117 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058b6c3-dd8c-431e-ab27-5d2d7be79ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.812559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058b6c3-dd8c-431e-ab27-5d2d7be79ba2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.823017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058b6c3-dd8c-431e-ab27-5d2d7be79ba2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:51.824316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f4457-71e9-4f3b-8217-6ffbd1d40944 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:51.825359 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058b6c3-dd8c-431e-ab27-5d2d7be79ba2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:51.838942 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941335a-5cf8-4b57-9d52-6cdd753393e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:51.839680 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941335a-5cf8-4b57-9d52-6cdd753393e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.839962 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941335a-5cf8-4b57-9d52-6cdd753393e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.840232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941335a-5cf8-4b57-9d52-6cdd753393e7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.844012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-7058b6c3-dd8c-431e-ab27-5d2d7be79ba2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:51.845702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 244/486] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:51.855575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058b6c3-dd8c-431e-ab27-5d2d7be79ba2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:51.862540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941335a-5cf8-4b57-9d52-6cdd753393e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:51.869728 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-8941335a-5cf8-4b57-9d52-6cdd753393e7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:25:51.871385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 243/487] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:51.875881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058b6c3-dd8c-431e-ab27-5d2d7be79ba2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:51.877679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941335a-5cf8-4b57-9d52-6cdd753393e7 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:51.888644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941335a-5cf8-4b57-9d52-6cdd753393e7 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:51.892738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42208e2b-c370-44e5-b0e9-a67223d8ed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:51.893401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42208e2b-c370-44e5-b0e9-a67223d8ed73 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.893683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42208e2b-c370-44e5-b0e9-a67223d8ed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.893953 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42208e2b-c370-44e5-b0e9-a67223d8ed73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.894718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42208e2b-c370-44e5-b0e9-a67223d8ed73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:51.895020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42208e2b-c370-44e5-b0e9-a67223d8ed73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:51.896621 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42208e2b-c370-44e5-b0e9-a67223d8ed73 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:51.906134 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d724b0c-370f-490f-ba24-28e51156e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:51.906825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724b0c-370f-490f-ba24-28e51156e8fc admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.907152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724b0c-370f-490f-ba24-28e51156e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.907370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724b0c-370f-490f-ba24-28e51156e8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.908128 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d724b0c-370f-490f-ba24-28e51156e8fc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:51.908444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d724b0c-370f-490f-ba24-28e51156e8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:51.910024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d724b0c-370f-490f-ba24-28e51156e8fc admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:51.919367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 245/488] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:51.925576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42208e2b-c370-44e5-b0e9-a67223d8ed73 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:51.932355 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 244/489] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:25:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:51.933194 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d724b0c-370f-490f-ba24-28e51156e8fc admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:51.943652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42208e2b-c370-44e5-b0e9-a67223d8ed73 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:51.948035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d724b0c-370f-490f-ba24-28e51156e8fc admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:51.954192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e6139-9b6a-4e62-8ea6-d84a77fb326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:51.955005 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e6139-9b6a-4e62-8ea6-d84a77fb326c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.955285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e6139-9b6a-4e62-8ea6-d84a77fb326c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.955556 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e6139-9b6a-4e62-8ea6-d84a77fb326c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.959436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53613c0b-f284-4dfc-abba-f865320c18c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:51.960243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53613c0b-f284-4dfc-abba-f865320c18c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.960524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53613c0b-f284-4dfc-abba-f865320c18c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.960797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53613c0b-f284-4dfc-abba-f865320c18c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.963894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e6139-9b6a-4e62-8ea6-d84a77fb326c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:51.965979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e6139-9b6a-4e62-8ea6-d84a77fb326c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:51.978871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53613c0b-f284-4dfc-abba-f865320c18c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:51.980692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53613c0b-f284-4dfc-abba-f865320c18c3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:51.981514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-cc0e6139-9b6a-4e62-8ea6-d84a77fb326c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 01:25:51.984007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 246/490] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:51.990357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e6139-9b6a-4e62-8ea6-d84a77fb326c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:51.998721 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-53613c0b-f284-4dfc-abba-f865320c18c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:52.000703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 245/491] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:52.000877 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e6139-9b6a-4e62-8ea6-d84a77fb326c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.005805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eb149-8003-47c1-885e-17ab8962eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.006108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53613c0b-f284-4dfc-abba-f865320c18c3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.006536 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eb149-8003-47c1-885e-17ab8962eee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.006814 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eb149-8003-47c1-885e-17ab8962eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.007088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eb149-8003-47c1-885e-17ab8962eee7 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.007983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eb149-8003-47c1-885e-17ab8962eee7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.008290 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eb149-8003-47c1-885e-17ab8962eee7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.009362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-7e5eb149-8003-47c1-885e-17ab8962eee7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:52.009362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:25:52.009362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:25:52.010570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eb149-8003-47c1-885e-17ab8962eee7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.015673 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53613c0b-f284-4dfc-abba-f865320c18c3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.020099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18c12c-0fd6-4ecd-b638-3ddeaeab8d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.020744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18c12c-0fd6-4ecd-b638-3ddeaeab8d49 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.021023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18c12c-0fd6-4ecd-b638-3ddeaeab8d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.021291 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18c12c-0fd6-4ecd-b638-3ddeaeab8d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.022009 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18c12c-0fd6-4ecd-b638-3ddeaeab8d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.022345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18c12c-0fd6-4ecd-b638-3ddeaeab8d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.023941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18c12c-0fd6-4ecd-b638-3ddeaeab8d49 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.048394 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 246/492] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:52.053557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 247/493] 10.222.0.79 () {56 vars in 1158 bytes} [Mon Feb 21 01:25:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:52.053759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18c12c-0fd6-4ecd-b638-3ddeaeab8d49 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.058880 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eb149-8003-47c1-885e-17ab8962eee7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.070785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eb149-8003-47c1-885e-17ab8962eee7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.075802 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355deaf-4809-4212-b68f-f297429763cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.076444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355deaf-4809-4212-b68f-f297429763cf admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.076570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18c12c-0fd6-4ecd-b638-3ddeaeab8d49 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.076772 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355deaf-4809-4212-b68f-f297429763cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.077081 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355deaf-4809-4212-b68f-f297429763cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.081617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66343445-8420-41fd-bd3a-9bb814185cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.082665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66343445-8420-41fd-bd3a-9bb814185cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.083157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66343445-8420-41fd-bd3a-9bb814185cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.083643 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66343445-8420-41fd-bd3a-9bb814185cb1 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.086482 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355deaf-4809-4212-b68f-f297429763cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.089156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355deaf-4809-4212-b68f-f297429763cf admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.100171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 248/494] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:52.105494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba86c-c899-403d-8a02-05937e68af7d None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.105494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba86c-c899-403d-8a02-05937e68af7d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.105494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba86c-c899-403d-8a02-05937e68af7d None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.105494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 249/495] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:52.107389 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66343445-8420-41fd-bd3a-9bb814185cb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.109503 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66343445-8420-41fd-bd3a-9bb814185cb1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.110232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dba86c-c899-403d-8a02-05937e68af7d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.127705 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-66343445-8420-41fd-bd3a-9bb814185cb1 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 01:25:52.129184 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 247/496] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:52.130383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c5a1d-5ed5-41ad-9e2c-05ae72f878f6 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.130667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c5a1d-5ed5-41ad-9e2c-05ae72f878f6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.130941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c5a1d-5ed5-41ad-9e2c-05ae72f878f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.132500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dba86c-c899-403d-8a02-05937e68af7d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.138682 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098e0f1-74f1-4838-9e6e-cb16cba8cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.142924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098e0f1-74f1-4838-9e6e-cb16cba8cbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.143475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098e0f1-74f1-4838-9e6e-cb16cba8cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.144428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098e0f1-74f1-4838-9e6e-cb16cba8cbd0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.149058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2d3c5a1d-5ed5-41ad-9e2c-05ae72f878f6 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:52.150264 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2d3c5a1d-5ed5-41ad-9e2c-05ae72f878f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:52.157554 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098e0f1-74f1-4838-9e6e-cb16cba8cbd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.162232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 248/497] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:52.162232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c5a1d-5ed5-41ad-9e2c-05ae72f878f6 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.164384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098e0f1-74f1-4838-9e6e-cb16cba8cbd0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.176493 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c5a1d-5ed5-41ad-9e2c-05ae72f878f6 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.186070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d1536-f57b-4e1d-9fbb-f8f2ce0c72e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.188193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d1536-f57b-4e1d-9fbb-f8f2ce0c72e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.188603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d1536-f57b-4e1d-9fbb-f8f2ce0c72e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.189064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d1536-f57b-4e1d-9fbb-f8f2ce0c72e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.190534 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d1536-f57b-4e1d-9fbb-f8f2ce0c72e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.190959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d1536-f57b-4e1d-9fbb-f8f2ce0c72e1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.192703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-5b9d1536-f57b-4e1d-9fbb-f8f2ce0c72e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:52.192703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:25:52.192703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:25:52.194066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d1536-f57b-4e1d-9fbb-f8f2ce0c72e1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.197672 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-f098e0f1-74f1-4838-9e6e-cb16cba8cbd0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:52.204141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 250/498] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:52.205482 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098e0f1-74f1-4838-9e6e-cb16cba8cbd0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.218173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098e0f1-74f1-4838-9e6e-cb16cba8cbd0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.228512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f224acd-9bc1-4271-9b61-19dd1ec1c8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.229811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f224acd-9bc1-4271-9b61-19dd1ec1c8da admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.230457 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f224acd-9bc1-4271-9b61-19dd1ec1c8da admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.231927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f224acd-9bc1-4271-9b61-19dd1ec1c8da admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.235881 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 249/499] 10.222.0.79 () {56 vars in 1158 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:52.236661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d1536-f57b-4e1d-9fbb-f8f2ce0c72e1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.248010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f224acd-9bc1-4271-9b61-19dd1ec1c8da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:52.248185 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d1536-f57b-4e1d-9fbb-f8f2ce0c72e1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.254811 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e199f-3777-4063-8fe2-62777111077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.255780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e199f-3777-4063-8fe2-62777111077e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.256157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e199f-3777-4063-8fe2-62777111077e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.256586 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e199f-3777-4063-8fe2-62777111077e admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.257493 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e199f-3777-4063-8fe2-62777111077e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.257845 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e199f-3777-4063-8fe2-62777111077e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.258711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-0f224acd-9bc1-4271-9b61-19dd1ec1c8da admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:25:52.259573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e199f-3777-4063-8fe2-62777111077e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.260328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 251/500] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:52.265978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f224acd-9bc1-4271-9b61-19dd1ec1c8da admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.281422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 250/501] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:52.283739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f224acd-9bc1-4271-9b61-19dd1ec1c8da admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.284770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e199f-3777-4063-8fe2-62777111077e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.294583 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231b744-a97a-4b8d-b113-f14ec6050f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.295223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231b744-a97a-4b8d-b113-f14ec6050f03 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.296075 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231b744-a97a-4b8d-b113-f14ec6050f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.296445 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231b744-a97a-4b8d-b113-f14ec6050f03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.297075 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e199f-3777-4063-8fe2-62777111077e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.301776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b751617-634e-41d1-9c21-0e20f332066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.302695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b751617-634e-41d1-9c21-0e20f332066f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.303176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b751617-634e-41d1-9c21-0e20f332066f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.303662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b751617-634e-41d1-9c21-0e20f332066f admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.304607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b751617-634e-41d1-9c21-0e20f332066f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.305120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b751617-634e-41d1-9c21-0e20f332066f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.305435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231b744-a97a-4b8d-b113-f14ec6050f03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.307171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b751617-634e-41d1-9c21-0e20f332066f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.307277 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231b744-a97a-4b8d-b113-f14ec6050f03 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.316487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 251/502] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:52.317483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b751617-634e-41d1-9c21-0e20f332066f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.318303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 252/503] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:52.327613 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231b744-a97a-4b8d-b113-f14ec6050f03 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.335930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b751617-634e-41d1-9c21-0e20f332066f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.337382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231b744-a97a-4b8d-b113-f14ec6050f03 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.341548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862e56-01e0-4f44-8bf1-83022e3920cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.342091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ed632-de23-4938-a3a6-317f79372521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.342899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862e56-01e0-4f44-8bf1-83022e3920cf admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.343005 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ed632-de23-4938-a3a6-317f79372521 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.343187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ed632-de23-4938-a3a6-317f79372521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.343460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ed632-de23-4938-a3a6-317f79372521 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.343885 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862e56-01e0-4f44-8bf1-83022e3920cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.344363 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862e56-01e0-4f44-8bf1-83022e3920cf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.353292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81862e56-01e0-4f44-8bf1-83022e3920cf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.354549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ed632-de23-4938-a3a6-317f79372521 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.356086 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81862e56-01e0-4f44-8bf1-83022e3920cf admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.356590 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ed632-de23-4938-a3a6-317f79372521 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.371920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-81862e56-01e0-4f44-8bf1-83022e3920cf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:25:52.373336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 252/504] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:52.375202 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862e56-01e0-4f44-8bf1-83022e3920cf admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.375552 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-eb3ed632-de23-4938-a3a6-317f79372521 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:52.377155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 253/505] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:52.380957 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ed632-de23-4938-a3a6-317f79372521 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.387267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862e56-01e0-4f44-8bf1-83022e3920cf admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.392650 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b1f0b-c46a-4207-beb9-49555c0202ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.393748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b1f0b-c46a-4207-beb9-49555c0202ff admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.394272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b1f0b-c46a-4207-beb9-49555c0202ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.394742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b1f0b-c46a-4207-beb9-49555c0202ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.394980 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ed632-de23-4938-a3a6-317f79372521 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.399526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6ddba-d144-4978-9e9a-24d0d1dfa120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.400179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6ddba-d144-4978-9e9a-24d0d1dfa120 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.400497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6ddba-d144-4978-9e9a-24d0d1dfa120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.400779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6ddba-d144-4978-9e9a-24d0d1dfa120 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.401590 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6ddba-d144-4978-9e9a-24d0d1dfa120 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.401944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6ddba-d144-4978-9e9a-24d0d1dfa120 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.403035 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-3aa6ddba-d144-4978-9e9a-24d0d1dfa120 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:52.403035 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:25:52.403035 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:25:52.404303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6ddba-d144-4978-9e9a-24d0d1dfa120 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.408273 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b1f0b-c46a-4207-beb9-49555c0202ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.410694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b1f0b-c46a-4207-beb9-49555c0202ff admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.423558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 254/506] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:52.424530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6ddba-d144-4978-9e9a-24d0d1dfa120 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.431003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-b17b1f0b-c46a-4207-beb9-49555c0202ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:52.432905 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 253/507] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:52.437499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6ddba-d144-4978-9e9a-24d0d1dfa120 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.438796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b1f0b-c46a-4207-beb9-49555c0202ff admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.441440 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d98a30-8936-470f-9900-a0e0e49fcc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.442129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98a30-8936-470f-9900-a0e0e49fcc8b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.442447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98a30-8936-470f-9900-a0e0e49fcc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.442720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98a30-8936-470f-9900-a0e0e49fcc8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.443494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d98a30-8936-470f-9900-a0e0e49fcc8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.443795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d98a30-8936-470f-9900-a0e0e49fcc8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.445503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d98a30-8936-470f-9900-a0e0e49fcc8b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.450919 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b1f0b-c46a-4207-beb9-49555c0202ff admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.456825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949db3d9-3e27-41c7-8067-cd0e6f7dece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.457659 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 255/508] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:52.458169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949db3d9-3e27-41c7-8067-cd0e6f7dece9 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.458777 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949db3d9-3e27-41c7-8067-cd0e6f7dece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.459251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949db3d9-3e27-41c7-8067-cd0e6f7dece9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.460267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949db3d9-3e27-41c7-8067-cd0e6f7dece9 admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=e68b3bc64dc94865a72cea0988fa9c65) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.460772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949db3d9-3e27-41c7-8067-cd0e6f7dece9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.462561 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d98a30-8936-470f-9900-a0e0e49fcc8b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.463199 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949db3d9-3e27-41c7-8067-cd0e6f7dece9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.470677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 254/509] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/role_assignments?user.id=e68b3bc64dc94865a72cea0988fa9c65&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:52.471898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949db3d9-3e27-41c7-8067-cd0e6f7dece9 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.473154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d98a30-8936-470f-9900-a0e0e49fcc8b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.478020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9bd8c-2568-4098-b079-f6cb3fe0a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.478771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9bd8c-2568-4098-b079-f6cb3fe0a50c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.479050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9bd8c-2568-4098-b079-f6cb3fe0a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.479321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9bd8c-2568-4098-b079-f6cb3fe0a50c admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.480324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9bd8c-2568-4098-b079-f6cb3fe0a50c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.480509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9bd8c-2568-4098-b079-f6cb3fe0a50c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.482357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9bd8c-2568-4098-b079-f6cb3fe0a50c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.487004 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949db3d9-3e27-41c7-8067-cd0e6f7dece9 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.492672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c68db-54f9-4422-9911-583094cf6e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.494457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c68db-54f9-4422-9911-583094cf6e9f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.495043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c68db-54f9-4422-9911-583094cf6e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.495511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c68db-54f9-4422-9911-583094cf6e9f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.497107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 256/510] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:52.508310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c68db-54f9-4422-9911-583094cf6e9f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.510808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c68db-54f9-4422-9911-583094cf6e9f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.514966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9bd8c-2568-4098-b079-f6cb3fe0a50c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.530977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-906c68db-54f9-4422-9911-583094cf6e9f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:25:52.532690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 255/511] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:52.541042 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9bd8c-2568-4098-b079-f6cb3fe0a50c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.542573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c68db-54f9-4422-9911-583094cf6e9f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.545486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fcef3-de27-4289-bdd1-b63de01c97b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.546928 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fcef3-de27-4289-bdd1-b63de01c97b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.547209 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fcef3-de27-4289-bdd1-b63de01c97b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.547523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fcef3-de27-4289-bdd1-b63de01c97b1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.562429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fcef3-de27-4289-bdd1-b63de01c97b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.562429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fcef3-de27-4289-bdd1-b63de01c97b1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.569077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c68db-54f9-4422-9911-583094cf6e9f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.581919 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac98bd9-113b-43a3-9520-7beb227f4a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.582659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98bd9-113b-43a3-9520-7beb227f4a64 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.582936 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98bd9-113b-43a3-9520-7beb227f4a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.583206 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98bd9-113b-43a3-9520-7beb227f4a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.584099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac98bd9-113b-43a3-9520-7beb227f4a64 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.584401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac98bd9-113b-43a3-9520-7beb227f4a64 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.585505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-1ac98bd9-113b-43a3-9520-7beb227f4a64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:25:52.585505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:25:52.585505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:25:52.587763 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-522fcef3-de27-4289-bdd1-b63de01c97b1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:25:52.588281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac98bd9-113b-43a3-9520-7beb227f4a64 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.591541 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 257/512] 10.222.0.79 () {56 vars in 1114 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:52.598053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fcef3-de27-4289-bdd1-b63de01c97b1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.617065 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fcef3-de27-4289-bdd1-b63de01c97b1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.627193 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47961514-e7d1-4dcd-bfe6-fbae93bea176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.627974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47961514-e7d1-4dcd-bfe6-fbae93bea176 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.628254 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47961514-e7d1-4dcd-bfe6-fbae93bea176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.628523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47961514-e7d1-4dcd-bfe6-fbae93bea176 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.630412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 256/513] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:52.630851 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47961514-e7d1-4dcd-bfe6-fbae93bea176 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.630851 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47961514-e7d1-4dcd-bfe6-fbae93bea176 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.631908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cae809-2fb5-4c4a-b86a-9d3e1fc0397b None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.632191 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cae809-2fb5-4c4a-b86a-9d3e1fc0397b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.632515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cae809-2fb5-4c4a-b86a-9d3e1fc0397b None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.632735 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47961514-e7d1-4dcd-bfe6-fbae93bea176 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.634671 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 257/514] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:52.643664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cae809-2fb5-4c4a-b86a-9d3e1fc0397b None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.653715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 258/515] 10.222.0.79 () {56 vars in 1154 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:52.655653 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fc341-070f-4d61-9dd8-e25e8f933c4c None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.655943 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fc341-070f-4d61-9dd8-e25e8f933c4c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.656220 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fc341-070f-4d61-9dd8-e25e8f933c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.658891 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cae809-2fb5-4c4a-b86a-9d3e1fc0397b None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.663398 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f6509-4bcf-4283-bcf0-50dbbc496b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.664097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f6509-4bcf-4283-bcf0-50dbbc496b2f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.664433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f6509-4bcf-4283-bcf0-50dbbc496b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.664707 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f6509-4bcf-4283-bcf0-50dbbc496b2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.665593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f6509-4bcf-4283-bcf0-50dbbc496b2f admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=48ca95750bea45019bdc0b34b8f445df) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.665901 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f6509-4bcf-4283-bcf0-50dbbc496b2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.667966 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f6509-4bcf-4283-bcf0-50dbbc496b2f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.675113 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 258/516] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/role_assignments?user.id=48ca95750bea45019bdc0b34b8f445df&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:52.682449 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f6509-4bcf-4283-bcf0-50dbbc496b2f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.682660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-0c1fc341-070f-4d61-9dd8-e25e8f933c4c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:52.687853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0c1fc341-070f-4d61-9dd8-e25e8f933c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:52.697394 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f6509-4bcf-4283-bcf0-50dbbc496b2f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.705719 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 259/517] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:52.707564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed611c-d155-4720-a271-4c4b2320d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.708232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed611c-d155-4720-a271-4c4b2320d750 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.708557 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed611c-d155-4720-a271-4c4b2320d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.708920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed611c-d155-4720-a271-4c4b2320d750 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.718832 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed611c-d155-4720-a271-4c4b2320d750 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.720719 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed611c-d155-4720-a271-4c4b2320d750 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.731029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 259/518] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:52.742624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fc341-070f-4d61-9dd8-e25e8f933c4c None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.743594 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed611c-d155-4720-a271-4c4b2320d750 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.755755 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fc341-070f-4d61-9dd8-e25e8f933c4c None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.757045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed611c-d155-4720-a271-4c4b2320d750 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.760386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7ed36-c6c9-4c1c-8077-5e21f40f7329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.761192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7ed36-c6c9-4c1c-8077-5e21f40f7329 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.761469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7ed36-c6c9-4c1c-8077-5e21f40f7329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.761737 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7ed36-c6c9-4c1c-8077-5e21f40f7329 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.763387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab14c6e-ed1b-467a-8af3-5c22b27aaf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.765059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab14c6e-ed1b-467a-8af3-5c22b27aaf44 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.765783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab14c6e-ed1b-467a-8af3-5c22b27aaf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.766116 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab14c6e-ed1b-467a-8af3-5c22b27aaf44 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.774355 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7ed36-c6c9-4c1c-8077-5e21f40f7329 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.776767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7ed36-c6c9-4c1c-8077-5e21f40f7329 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.779556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab14c6e-ed1b-467a-8af3-5c22b27aaf44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:52.789249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-9ab14c6e-ed1b-467a-8af3-5c22b27aaf44 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:25:52.790830 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 260/519] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:52.796796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab14c6e-ed1b-467a-8af3-5c22b27aaf44 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.797469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-dab7ed36-c6c9-4c1c-8077-5e21f40f7329 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:52.798743 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 260/520] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:52.807242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7ed36-c6c9-4c1c-8077-5e21f40f7329 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.817556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab14c6e-ed1b-467a-8af3-5c22b27aaf44 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.818230 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7ed36-c6c9-4c1c-8077-5e21f40f7329 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.832603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f717a-4729-407e-b5a9-b8da6c5ada9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.833670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec043ba-fb81-4565-8e8f-a96e1e84a9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.834451 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec043ba-fb81-4565-8e8f-a96e1e84a9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.834915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f717a-4729-407e-b5a9-b8da6c5ada9a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.835189 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f717a-4729-407e-b5a9-b8da6c5ada9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.836393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec043ba-fb81-4565-8e8f-a96e1e84a9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.836664 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec043ba-fb81-4565-8e8f-a96e1e84a9a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.837422 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec043ba-fb81-4565-8e8f-a96e1e84a9a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.837942 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f717a-4729-407e-b5a9-b8da6c5ada9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.838486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec043ba-fb81-4565-8e8f-a96e1e84a9a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.839512 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f717a-4729-407e-b5a9-b8da6c5ada9a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.839813 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f717a-4729-407e-b5a9-b8da6c5ada9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.842144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec043ba-fb81-4565-8e8f-a96e1e84a9a0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.843992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f717a-4729-407e-b5a9-b8da6c5ada9a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.872579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 261/521] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:52.873044 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 261/522] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:52.880684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f717a-4729-407e-b5a9-b8da6c5ada9a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.889500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec043ba-fb81-4565-8e8f-a96e1e84a9a0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.904294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f717a-4729-407e-b5a9-b8da6c5ada9a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.904839 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec043ba-fb81-4565-8e8f-a96e1e84a9a0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.910813 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cba0c8-b4b0-477e-9c41-a41d3fd14725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.911798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cba0c8-b4b0-477e-9c41-a41d3fd14725 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.912131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cba0c8-b4b0-477e-9c41-a41d3fd14725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.912403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cba0c8-b4b0-477e-9c41-a41d3fd14725 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.913584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564a8da-edd8-49f4-8639-0c1f26ced222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.914873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564a8da-edd8-49f4-8639-0c1f26ced222 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.915776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564a8da-edd8-49f4-8639-0c1f26ced222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.916323 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564a8da-edd8-49f4-8639-0c1f26ced222 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.921233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cba0c8-b4b0-477e-9c41-a41d3fd14725 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.923420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cba0c8-b4b0-477e-9c41-a41d3fd14725 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.931077 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564a8da-edd8-49f4-8639-0c1f26ced222 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.933233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564a8da-edd8-49f4-8639-0c1f26ced222 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.937584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-d2cba0c8-b4b0-477e-9c41-a41d3fd14725 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:25:52.938984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 262/523] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:52.944413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cba0c8-b4b0-477e-9c41-a41d3fd14725 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.953222 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-1564a8da-edd8-49f4-8639-0c1f26ced222 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:52.954814 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cba0c8-b4b0-477e-9c41-a41d3fd14725 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.955250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 262/524] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:52.961208 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564a8da-edd8-49f4-8639-0c1f26ced222 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:52.969016 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356e94b-3e70-40cc-b011-a22e8855f6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.969686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e94b-3e70-40cc-b011-a22e8855f6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.969968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e94b-3e70-40cc-b011-a22e8855f6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.970267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e94b-3e70-40cc-b011-a22e8855f6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.971068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356e94b-3e70-40cc-b011-a22e8855f6b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.971376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356e94b-3e70-40cc-b011-a22e8855f6b6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.974955 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356e94b-3e70-40cc-b011-a22e8855f6b6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:52.979164 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564a8da-edd8-49f4-8639-0c1f26ced222 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:52.993491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc6ae4-7acf-4654-860e-a3ec5159a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:52.994163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc6ae4-7acf-4654-860e-a3ec5159a1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:52.994479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc6ae4-7acf-4654-860e-a3ec5159a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:52.994757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc6ae4-7acf-4654-860e-a3ec5159a1f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:52.995487 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc6ae4-7acf-4654-860e-a3ec5159a1f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:52.995798 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc6ae4-7acf-4654-860e-a3ec5159a1f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:52.997405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc6ae4-7acf-4654-860e-a3ec5159a1f5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.003076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 263/525] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:53.009032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356e94b-3e70-40cc-b011-a22e8855f6b6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:53.022216 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356e94b-3e70-40cc-b011-a22e8855f6b6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:53.026935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba170-f94a-4431-94a2-3900d0305581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:53.027588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba170-f94a-4431-94a2-3900d0305581 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.027875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba170-f94a-4431-94a2-3900d0305581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.028153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba170-f94a-4431-94a2-3900d0305581 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.028249 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 263/526] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:53.028984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ba170-f94a-4431-94a2-3900d0305581 admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=333ec5b3842b432a99bc265abbe7fa58) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:53.029296 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ba170-f94a-4431-94a2-3900d0305581 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:53.031271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ba170-f94a-4431-94a2-3900d0305581 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.034555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc6ae4-7acf-4654-860e-a3ec5159a1f5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:53.037605 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 264/527] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:53 2022] GET /identity/v3/role_assignments?user.id=333ec5b3842b432a99bc265abbe7fa58&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:53.049267 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc6ae4-7acf-4654-860e-a3ec5159a1f5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:53.054002 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4726072-068c-44a8-b861-363173f37acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:53.054878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4726072-068c-44a8-b861-363173f37acf admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.055262 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4726072-068c-44a8-b861-363173f37acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.055547 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4726072-068c-44a8-b861-363173f37acf admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.065872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4726072-068c-44a8-b861-363173f37acf admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:53.068113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4726072-068c-44a8-b861-363173f37acf admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.085441 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-d4726072-068c-44a8-b861-363173f37acf admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 01:25:53.087221 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 264/528] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:53.094902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba170-f94a-4431-94a2-3900d0305581 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:53.105635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba170-f94a-4431-94a2-3900d0305581 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:53.110981 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83b1ec-e953-448e-8b38-dee6b8072023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:53.111712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83b1ec-e953-448e-8b38-dee6b8072023 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.111997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83b1ec-e953-448e-8b38-dee6b8072023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.112269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83b1ec-e953-448e-8b38-dee6b8072023 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.113215 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83b1ec-e953-448e-8b38-dee6b8072023 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:53.113561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83b1ec-e953-448e-8b38-dee6b8072023 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:53.115550 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83b1ec-e953-448e-8b38-dee6b8072023 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.136963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 265/529] 10.222.0.79 () {56 vars in 1160 bytes} [Mon Feb 21 01:25:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:53.142510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4726072-068c-44a8-b861-363173f37acf admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:53.153568 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4726072-068c-44a8-b861-363173f37acf admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:53.159048 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8a6da-75dd-4a5d-8cd1-9cf00ad8fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:53.159699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a6da-75dd-4a5d-8cd1-9cf00ad8fac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.160039 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a6da-75dd-4a5d-8cd1-9cf00ad8fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.160312 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a6da-75dd-4a5d-8cd1-9cf00ad8fac9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.169869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8a6da-75dd-4a5d-8cd1-9cf00ad8fac9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:53.172384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8a6da-75dd-4a5d-8cd1-9cf00ad8fac9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.182505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 265/530] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:53.188139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83b1ec-e953-448e-8b38-dee6b8072023 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:53.216918 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83b1ec-e953-448e-8b38-dee6b8072023 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:53.232437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc0cc-0d6b-441d-82fb-eeaa00e2b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:53.233813 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc0cc-0d6b-441d-82fb-eeaa00e2b2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.234103 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc0cc-0d6b-441d-82fb-eeaa00e2b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.234419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc0cc-0d6b-441d-82fb-eeaa00e2b2a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.255675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dc0cc-0d6b-441d-82fb-eeaa00e2b2a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:53.257917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dc0cc-0d6b-441d-82fb-eeaa00e2b2a3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.286671 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-048dc0cc-0d6b-441d-82fb-eeaa00e2b2a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:53.288214 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 266/531] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:53.293900 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8a6da-75dd-4a5d-8cd1-9cf00ad8fac9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:53.307449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8a6da-75dd-4a5d-8cd1-9cf00ad8fac9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:53.315828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576bc2e-3e00-441c-b7dd-75e15e00a5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:53.316499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576bc2e-3e00-441c-b7dd-75e15e00a5dc admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.316776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576bc2e-3e00-441c-b7dd-75e15e00a5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.317052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576bc2e-3e00-441c-b7dd-75e15e00a5dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.317787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576bc2e-3e00-441c-b7dd-75e15e00a5dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:53.318094 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576bc2e-3e00-441c-b7dd-75e15e00a5dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:53.319806 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576bc2e-3e00-441c-b7dd-75e15e00a5dc admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.336187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 266/532] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:53.341967 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc0cc-0d6b-441d-82fb-eeaa00e2b2a3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:53.355436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc0cc-0d6b-441d-82fb-eeaa00e2b2a3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:53.362048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8c6e8-9e36-440d-8586-acc7dd03ab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:53.362877 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8c6e8-9e36-440d-8586-acc7dd03ab97 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.363161 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8c6e8-9e36-440d-8586-acc7dd03ab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.363435 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8c6e8-9e36-440d-8586-acc7dd03ab97 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.373233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8c6e8-9e36-440d-8586-acc7dd03ab97 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:53.375570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8c6e8-9e36-440d-8586-acc7dd03ab97 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.391440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-dbb8c6e8-9e36-440d-8586-acc7dd03ab97 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:25:53.392745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 267/533] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:53.398612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576bc2e-3e00-441c-b7dd-75e15e00a5dc admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:53.411321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576bc2e-3e00-441c-b7dd-75e15e00a5dc admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:53.421614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b361be9-7793-40db-beb9-f0ef15f725cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:53.422318 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b361be9-7793-40db-beb9-f0ef15f725cd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.422603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b361be9-7793-40db-beb9-f0ef15f725cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.422908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b361be9-7793-40db-beb9-f0ef15f725cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.423685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b361be9-7793-40db-beb9-f0ef15f725cd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:53.423993 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b361be9-7793-40db-beb9-f0ef15f725cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:53.425854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b361be9-7793-40db-beb9-f0ef15f725cd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.441506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 267/534] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:53.447927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8c6e8-9e36-440d-8586-acc7dd03ab97 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:53.463498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8c6e8-9e36-440d-8586-acc7dd03ab97 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:53.467393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153c4d0-51eb-48e7-b4c8-830e80d91773 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.468215 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153c4d0-51eb-48e7-b4c8-830e80d91773 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.468488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153c4d0-51eb-48e7-b4c8-830e80d91773 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.470510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 268/535] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:53.472920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598aed9-fdbc-4722-973c-f1abb8b74876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:53.473581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598aed9-fdbc-4722-973c-f1abb8b74876 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.473861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598aed9-fdbc-4722-973c-f1abb8b74876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.475527 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598aed9-fdbc-4722-973c-f1abb8b74876 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.475706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95073241-b7fc-43d6-82dd-70edad6db8ec None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.475850 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95073241-b7fc-43d6-82dd-70edad6db8ec None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.476082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95073241-b7fc-43d6-82dd-70edad6db8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.478316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598aed9-fdbc-4722-973c-f1abb8b74876 admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=3f00b174c88547e2ab799d89a50d5b6a) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:53.478490 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598aed9-fdbc-4722-973c-f1abb8b74876 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:53.480312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598aed9-fdbc-4722-973c-f1abb8b74876 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.496804 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 268/536] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:53 2022] GET /identity/v3/role_assignments?user.id=3f00b174c88547e2ab799d89a50d5b6a&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:53.503012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-95073241-b7fc-43d6-82dd-70edad6db8ec None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:53.504210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-95073241-b7fc-43d6-82dd-70edad6db8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:53.512846 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 269/537] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:53.558405 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598aed9-fdbc-4722-973c-f1abb8b74876 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:53.569047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598aed9-fdbc-4722-973c-f1abb8b74876 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:53.574342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284c421-1930-47f5-aa3e-5fc6d0bf65e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:53.575300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284c421-1930-47f5-aa3e-5fc6d0bf65e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.575655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284c421-1930-47f5-aa3e-5fc6d0bf65e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.576002 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284c421-1930-47f5-aa3e-5fc6d0bf65e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.593516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284c421-1930-47f5-aa3e-5fc6d0bf65e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:53.595742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284c421-1930-47f5-aa3e-5fc6d0bf65e7 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.614510 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-7284c421-1930-47f5-aa3e-5fc6d0bf65e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:53.616245 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 269/538] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:53.621695 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95073241-b7fc-43d6-82dd-70edad6db8ec None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:53.631494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95073241-b7fc-43d6-82dd-70edad6db8ec None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:53.636321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd0bd3-65e4-40c6-b80e-c4329709ff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:53.637113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd0bd3-65e4-40c6-b80e-c4329709ff0d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.637502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd0bd3-65e4-40c6-b80e-c4329709ff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.637901 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd0bd3-65e4-40c6-b80e-c4329709ff0d admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.638795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd0bd3-65e4-40c6-b80e-c4329709ff0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:53.639208 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd0bd3-65e4-40c6-b80e-c4329709ff0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:53.641675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd0bd3-65e4-40c6-b80e-c4329709ff0d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.654237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 270/539] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:53.663325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284c421-1930-47f5-aa3e-5fc6d0bf65e7 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:53.674355 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284c421-1930-47f5-aa3e-5fc6d0bf65e7 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:53.682643 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78400522-fb14-4d48-bcdd-83ae26e33cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:53.683372 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78400522-fb14-4d48-bcdd-83ae26e33cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:53.683706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78400522-fb14-4d48-bcdd-83ae26e33cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:53.683985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78400522-fb14-4d48-bcdd-83ae26e33cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:53.684758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78400522-fb14-4d48-bcdd-83ae26e33cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:53.686855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78400522-fb14-4d48-bcdd-83ae26e33cb5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:53.721805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 270/540] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:25:53 2022] POST /identity/v3/users => generated 247 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:25:55.291930 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12949ef2-6441-463f-b0bc-53a9d2d3178e None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.292618 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12949ef2-6441-463f-b0bc-53a9d2d3178e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.292618 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12949ef2-6441-463f-b0bc-53a9d2d3178e None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.294516 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 271/541] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:55.300504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9ce62-5cf8-4c56-9cc1-e7ddc03beb39 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.301015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9ce62-5cf8-4c56-9cc1-e7ddc03beb39 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.301172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9ce62-5cf8-4c56-9cc1-e7ddc03beb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.320124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-b0d9ce62-5cf8-4c56-9cc1-e7ddc03beb39 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:55.321312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b0d9ce62-5cf8-4c56-9cc1-e7ddc03beb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:55.329519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 271/542] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:55.352312 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12949ef2-6441-463f-b0bc-53a9d2d3178e None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.365163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12949ef2-6441-463f-b0bc-53a9d2d3178e None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.369508 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21bf9a-6308-40fd-907a-53a419aa6395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.370316 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21bf9a-6308-40fd-907a-53a419aa6395 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.370604 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21bf9a-6308-40fd-907a-53a419aa6395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.370875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21bf9a-6308-40fd-907a-53a419aa6395 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.382769 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21bf9a-6308-40fd-907a-53a419aa6395 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:55.389765 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-af21bf9a-6308-40fd-907a-53a419aa6395 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:25:55.391319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 272/543] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:55.397145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9ce62-5cf8-4c56-9cc1-e7ddc03beb39 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.406749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9ce62-5cf8-4c56-9cc1-e7ddc03beb39 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.415358 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e0c4-0f70-4b71-8477-2b798f203c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.416033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e0c4-0f70-4b71-8477-2b798f203c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.416313 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e0c4-0f70-4b71-8477-2b798f203c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.416584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e0c4-0f70-4b71-8477-2b798f203c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.417337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100e0c4-0f70-4b71-8477-2b798f203c5d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:55.417640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100e0c4-0f70-4b71-8477-2b798f203c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.419361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100e0c4-0f70-4b71-8477-2b798f203c5d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.433810 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 272/544] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:55.439336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21bf9a-6308-40fd-907a-53a419aa6395 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.452896 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21bf9a-6308-40fd-907a-53a419aa6395 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.457462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dabb83-3dba-4e50-b53e-77be3fd07a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.458295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dabb83-3dba-4e50-b53e-77be3fd07a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.458556 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dabb83-3dba-4e50-b53e-77be3fd07a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.458835 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dabb83-3dba-4e50-b53e-77be3fd07a2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.469829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dabb83-3dba-4e50-b53e-77be3fd07a2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.471733 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dabb83-3dba-4e50-b53e-77be3fd07a2a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.487535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cbb79-79b7-42dd-82e2-a2d42ea7c300 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.487836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cbb79-79b7-42dd-82e2-a2d42ea7c300 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.488088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cbb79-79b7-42dd-82e2-a2d42ea7c300 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.490109 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 273/545] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:55.495297 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118359b-bce2-4d3f-a237-39a761d20247 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.495583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118359b-bce2-4d3f-a237-39a761d20247 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.495858 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118359b-bce2-4d3f-a237-39a761d20247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.496209 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-e0dabb83-3dba-4e50-b53e-77be3fd07a2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:55.497422 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 273/546] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:55.503291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dabb83-3dba-4e50-b53e-77be3fd07a2a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.513388 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dabb83-3dba-4e50-b53e-77be3fd07a2a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.518306 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fa10f-5b9c-4e14-a0e8-d8fe197524b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.518977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fa10f-5b9c-4e14-a0e8-d8fe197524b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.519258 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fa10f-5b9c-4e14-a0e8-d8fe197524b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.519592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fa10f-5b9c-4e14-a0e8-d8fe197524b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.520326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fa10f-5b9c-4e14-a0e8-d8fe197524b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:55.520679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fa10f-5b9c-4e14-a0e8-d8fe197524b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.522426 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fa10f-5b9c-4e14-a0e8-d8fe197524b9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.535236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-8118359b-bce2-4d3f-a237-39a761d20247 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:55.535533 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 274/547] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:55.536513 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8118359b-bce2-4d3f-a237-39a761d20247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:55.540860 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fa10f-5b9c-4e14-a0e8-d8fe197524b9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.551352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fa10f-5b9c-4e14-a0e8-d8fe197524b9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.556014 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126ff81-f00e-4cc4-94e2-207de95d9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.556819 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126ff81-f00e-4cc4-94e2-207de95d9cde admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.556995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 274/548] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:55.557160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126ff81-f00e-4cc4-94e2-207de95d9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.557320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126ff81-f00e-4cc4-94e2-207de95d9cde admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.565856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126ff81-f00e-4cc4-94e2-207de95d9cde admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.567989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126ff81-f00e-4cc4-94e2-207de95d9cde admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.582471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-3126ff81-f00e-4cc4-94e2-207de95d9cde admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 01:25:55.583712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 275/549] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:55.589349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118359b-bce2-4d3f-a237-39a761d20247 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.598531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126ff81-f00e-4cc4-94e2-207de95d9cde admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.605702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118359b-bce2-4d3f-a237-39a761d20247 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.611960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126ff81-f00e-4cc4-94e2-207de95d9cde admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.618947 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a885f0-6f06-4d63-bef2-62b1cdfd293c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.619903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b378ea-3812-4ab0-9b73-89cbfe977bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.620860 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a885f0-6f06-4d63-bef2-62b1cdfd293c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.621138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a885f0-6f06-4d63-bef2-62b1cdfd293c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.621439 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b378ea-3812-4ab0-9b73-89cbfe977bce admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.621753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b378ea-3812-4ab0-9b73-89cbfe977bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.622032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b378ea-3812-4ab0-9b73-89cbfe977bce admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.622583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a885f0-6f06-4d63-bef2-62b1cdfd293c admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.625126 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a885f0-6f06-4d63-bef2-62b1cdfd293c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:55.625442 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a885f0-6f06-4d63-bef2-62b1cdfd293c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.628223 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a885f0-6f06-4d63-bef2-62b1cdfd293c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.642365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b378ea-3812-4ab0-9b73-89cbfe977bce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:55.657934 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-94b378ea-3812-4ab0-9b73-89cbfe977bce admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:25:55.659437 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 276/550] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:55.661589 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 275/551] 10.222.0.79 () {56 vars in 1158 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:55.666652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b378ea-3812-4ab0-9b73-89cbfe977bce admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.667951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a885f0-6f06-4d63-bef2-62b1cdfd293c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.685216 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a885f0-6f06-4d63-bef2-62b1cdfd293c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.688196 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b378ea-3812-4ab0-9b73-89cbfe977bce admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.695715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dec863-b570-462c-8daa-3e5d31645ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.696932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dec863-b570-462c-8daa-3e5d31645ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.697222 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dec863-b570-462c-8daa-3e5d31645ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.697508 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dec863-b570-462c-8daa-3e5d31645ed9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.698974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd6d2-5dee-4966-9f6f-265b5fac8446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.699674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd6d2-5dee-4966-9f6f-265b5fac8446 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.699956 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd6d2-5dee-4966-9f6f-265b5fac8446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.700231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd6d2-5dee-4966-9f6f-265b5fac8446 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.701804 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bd6d2-5dee-4966-9f6f-265b5fac8446 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:55.702129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bd6d2-5dee-4966-9f6f-265b5fac8446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.706161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bd6d2-5dee-4966-9f6f-265b5fac8446 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.721022 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dec863-b570-462c-8daa-3e5d31645ed9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.722926 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dec863-b570-462c-8daa-3e5d31645ed9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.724910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 277/552] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:55.735030 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd6d2-5dee-4966-9f6f-265b5fac8446 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.746514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-49dec863-b570-462c-8daa-3e5d31645ed9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:55.748315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd6d2-5dee-4966-9f6f-265b5fac8446 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.752399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 276/553] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:55.753790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dec863-b570-462c-8daa-3e5d31645ed9 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.762784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc7df3-8029-483f-8acf-4145a85cf166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.763577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc7df3-8029-483f-8acf-4145a85cf166 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.763859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc7df3-8029-483f-8acf-4145a85cf166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.764127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc7df3-8029-483f-8acf-4145a85cf166 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.774916 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dec863-b570-462c-8daa-3e5d31645ed9 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.783587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc7df3-8029-483f-8acf-4145a85cf166 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.788337 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc7df3-8029-483f-8acf-4145a85cf166 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.789644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ce129-4b1d-4862-b32f-9948b81e1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.790597 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ce129-4b1d-4862-b32f-9948b81e1d6e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.791628 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ce129-4b1d-4862-b32f-9948b81e1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.793405 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ce129-4b1d-4862-b32f-9948b81e1d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.794380 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ce129-4b1d-4862-b32f-9948b81e1d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:55.795219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ce129-4b1d-4862-b32f-9948b81e1d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.798127 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ce129-4b1d-4862-b32f-9948b81e1d6e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.821320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-19fc7df3-8029-483f-8acf-4145a85cf166 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:55.823753 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 277/554] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:55.825353 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 278/555] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:55.833879 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ce129-4b1d-4862-b32f-9948b81e1d6e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.834231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc7df3-8029-483f-8acf-4145a85cf166 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.849315 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ce129-4b1d-4862-b32f-9948b81e1d6e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.862298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc7df3-8029-483f-8acf-4145a85cf166 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.864538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb3b4-bb40-47ad-bbb7-e1d0ab3a4acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.866852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb3b4-bb40-47ad-bbb7-e1d0ab3a4acf admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.867146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb3b4-bb40-47ad-bbb7-e1d0ab3a4acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.867435 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb3b4-bb40-47ad-bbb7-e1d0ab3a4acf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.869050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb9b04-31f8-42f7-b1c0-8f8cb497ba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.869697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb9b04-31f8-42f7-b1c0-8f8cb497ba18 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.869981 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb9b04-31f8-42f7-b1c0-8f8cb497ba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.871845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb9b04-31f8-42f7-b1c0-8f8cb497ba18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.872584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb9b04-31f8-42f7-b1c0-8f8cb497ba18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:55.873736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb9b04-31f8-42f7-b1c0-8f8cb497ba18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.879113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb9b04-31f8-42f7-b1c0-8f8cb497ba18 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.882442 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bb3b4-bb40-47ad-bbb7-e1d0ab3a4acf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.888674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bb3b4-bb40-47ad-bbb7-e1d0ab3a4acf admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.900520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 279/556] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:55.906249 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb9b04-31f8-42f7-b1c0-8f8cb497ba18 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.910460 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-9a9bb3b4-bb40-47ad-bbb7-e1d0ab3a4acf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:25:55.921229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb9b04-31f8-42f7-b1c0-8f8cb497ba18 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.921738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 278/557] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:55.924352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb3b4-bb40-47ad-bbb7-e1d0ab3a4acf admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:55.934357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b7862-150c-4c6e-92cf-ea929adf4d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.935410 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b7862-150c-4c6e-92cf-ea929adf4d0d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.935908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b7862-150c-4c6e-92cf-ea929adf4d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.936445 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b7862-150c-4c6e-92cf-ea929adf4d0d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.939169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb3b4-bb40-47ad-bbb7-e1d0ab3a4acf admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:55.951670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b7862-150c-4c6e-92cf-ea929adf4d0d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.954989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b7862-150c-4c6e-92cf-ea929adf4d0d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.956335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae75ee6-3d86-4ddb-96a0-658bb1d62c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:55.957246 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae75ee6-3d86-4ddb-96a0-658bb1d62c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:55.957721 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae75ee6-3d86-4ddb-96a0-658bb1d62c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:55.958186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae75ee6-3d86-4ddb-96a0-658bb1d62c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:55.959213 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae75ee6-3d86-4ddb-96a0-658bb1d62c54 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:55.959733 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae75ee6-3d86-4ddb-96a0-658bb1d62c54 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:55.961757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae75ee6-3d86-4ddb-96a0-658bb1d62c54 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:55.982902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-6f3b7862-150c-4c6e-92cf-ea929adf4d0d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 01:25:55.988472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 279/558] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:55.989775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 280/559] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:55.998266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae75ee6-3d86-4ddb-96a0-658bb1d62c54 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.000589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b7862-150c-4c6e-92cf-ea929adf4d0d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.014742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae75ee6-3d86-4ddb-96a0-658bb1d62c54 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.021067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b7862-150c-4c6e-92cf-ea929adf4d0d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.025127 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4a9dc-bb89-4af2-a194-a1022cbc95f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.025792 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4a9dc-bb89-4af2-a194-a1022cbc95f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.026068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4a9dc-bb89-4af2-a194-a1022cbc95f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.026364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4a9dc-bb89-4af2-a194-a1022cbc95f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.027199 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4a9dc-bb89-4af2-a194-a1022cbc95f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:56.027501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4a9dc-bb89-4af2-a194-a1022cbc95f2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.029326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4a9dc-bb89-4af2-a194-a1022cbc95f2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.034044 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4112ac-d9b9-4c4e-8457-a62af89297c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.034935 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4112ac-d9b9-4c4e-8457-a62af89297c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.035207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4112ac-d9b9-4c4e-8457-a62af89297c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.035470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4112ac-d9b9-4c4e-8457-a62af89297c0 admin admin] PATH_INFO: `/v3/projects/0eaab085a52a4171be0afec37707daca/users/e68b3bc64dc94865a72cea0988fa9c65/roles/8a020c6e5d94457ca1f453a3531c89b2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.065471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 280/560] 10.222.0.79 () {56 vars in 1158 bytes} [Mon Feb 21 01:25:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:56.066752 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4a9dc-bb89-4af2-a194-a1022cbc95f2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.072189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4112ac-d9b9-4c4e-8457-a62af89297c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaab085a52a4171be0afec37707daca, user_id=e68b3bc64dc94865a72cea0988fa9c65, role_id=8a020c6e5d94457ca1f453a3531c89b2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.074882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4112ac-d9b9-4c4e-8457-a62af89297c0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.076286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4a9dc-bb89-4af2-a194-a1022cbc95f2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.086237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a534f-5113-4045-a02e-b85c85bdf360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.087185 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a534f-5113-4045-a02e-b85c85bdf360 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.087558 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a534f-5113-4045-a02e-b85c85bdf360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.087898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a534f-5113-4045-a02e-b85c85bdf360 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.102384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 281/561] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:55 2022] PUT /identity/v3/projects/0eaab085a52a4171be0afec37707daca/users/e68b3bc64dc94865a72cea0988fa9c65/roles/8a020c6e5d94457ca1f453a3531c89b2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:56.113450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a534f-5113-4045-a02e-b85c85bdf360 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.117050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac714b0-758b-4dee-b595-35a0290d7731 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.117379 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac714b0-758b-4dee-b595-35a0290d7731 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.117597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac714b0-758b-4dee-b595-35a0290d7731 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.119629 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 282/562] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:56.120215 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a534f-5113-4045-a02e-b85c85bdf360 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.135435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d5369-9760-4007-9c69-c61c01b12a3d None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.135748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d5369-9760-4007-9c69-c61c01b12a3d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.136048 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d5369-9760-4007-9c69-c61c01b12a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.161583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-e74a534f-5113-4045-a02e-b85c85bdf360 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:56.166024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 281/563] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:56.167059 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-309d5369-9760-4007-9c69-c61c01b12a3d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:56.168253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-309d5369-9760-4007-9c69-c61c01b12a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:56.171862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a534f-5113-4045-a02e-b85c85bdf360 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.185102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a534f-5113-4045-a02e-b85c85bdf360 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.284840 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd455c-9c0b-4a15-9872-131bb1afc4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.285516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd455c-9c0b-4a15-9872-131bb1afc4ec admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.285804 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd455c-9c0b-4a15-9872-131bb1afc4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.286082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd455c-9c0b-4a15-9872-131bb1afc4ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.286853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd455c-9c0b-4a15-9872-131bb1afc4ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:56.287161 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd455c-9c0b-4a15-9872-131bb1afc4ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.288815 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd455c-9c0b-4a15-9872-131bb1afc4ec admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.303870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 283/564] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:56.309460 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 282/565] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:56.315325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d5369-9760-4007-9c69-c61c01b12a3d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.328314 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd455c-9c0b-4a15-9872-131bb1afc4ec admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.328859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d5369-9760-4007-9c69-c61c01b12a3d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.340542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009b12d-3f6e-4216-8df8-93d2c7e1d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.340874 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd455c-9c0b-4a15-9872-131bb1afc4ec admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.341350 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009b12d-3f6e-4216-8df8-93d2c7e1d1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.341728 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009b12d-3f6e-4216-8df8-93d2c7e1d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.342108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009b12d-3f6e-4216-8df8-93d2c7e1d1c1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.346963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828b1b1-8929-4fd6-80e4-63684f4bb732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.347913 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828b1b1-8929-4fd6-80e4-63684f4bb732 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.348244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828b1b1-8929-4fd6-80e4-63684f4bb732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.348564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828b1b1-8929-4fd6-80e4-63684f4bb732 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.353693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009b12d-3f6e-4216-8df8-93d2c7e1d1c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.356339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009b12d-3f6e-4216-8df8-93d2c7e1d1c1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.360004 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828b1b1-8929-4fd6-80e4-63684f4bb732 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:56.367524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-8828b1b1-8929-4fd6-80e4-63684f4bb732 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:25:56.368974 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 283/566] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:56.370887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-8009b12d-3f6e-4216-8df8-93d2c7e1d1c1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:25:56.372095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 284/567] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:56.377059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828b1b1-8929-4fd6-80e4-63684f4bb732 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.383356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009b12d-3f6e-4216-8df8-93d2c7e1d1c1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.387803 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828b1b1-8929-4fd6-80e4-63684f4bb732 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.393145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851426e-9c59-440b-ad4b-f38f58319f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.393815 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851426e-9c59-440b-ad4b-f38f58319f7d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.394092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851426e-9c59-440b-ad4b-f38f58319f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.394402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851426e-9c59-440b-ad4b-f38f58319f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.394504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009b12d-3f6e-4216-8df8-93d2c7e1d1c1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.395167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851426e-9c59-440b-ad4b-f38f58319f7d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:56.395461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851426e-9c59-440b-ad4b-f38f58319f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.397069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851426e-9c59-440b-ad4b-f38f58319f7d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.399224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d812d9e-a666-4cf4-8120-b841faba8061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.400031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d812d9e-a666-4cf4-8120-b841faba8061 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.400306 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d812d9e-a666-4cf4-8120-b841faba8061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.400577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d812d9e-a666-4cf4-8120-b841faba8061 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.401357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d812d9e-a666-4cf4-8120-b841faba8061 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:56.401658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d812d9e-a666-4cf4-8120-b841faba8061 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.403573 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d812d9e-a666-4cf4-8120-b841faba8061 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.408604 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 284/568] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:56.414069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851426e-9c59-440b-ad4b-f38f58319f7d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.424477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 285/569] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:56.425282 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851426e-9c59-440b-ad4b-f38f58319f7d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.427189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d812d9e-a666-4cf4-8120-b841faba8061 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.431463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a65c8b-1301-44ea-b5b1-536523c0b3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.432783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a65c8b-1301-44ea-b5b1-536523c0b3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.433861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a65c8b-1301-44ea-b5b1-536523c0b3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.434421 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a65c8b-1301-44ea-b5b1-536523c0b3b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.438268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d812d9e-a666-4cf4-8120-b841faba8061 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.443139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3a0b5-3253-46e8-9166-756df0f46b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.444181 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3a0b5-3253-46e8-9166-756df0f46b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.444543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3a0b5-3253-46e8-9166-756df0f46b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.444894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3a0b5-3253-46e8-9166-756df0f46b80 admin admin] PATH_INFO: `/v3/projects/0eaab085a52a4171be0afec37707daca/users/48ca95750bea45019bdc0b34b8f445df/roles/8a020c6e5d94457ca1f453a3531c89b2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.449834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a65c8b-1301-44ea-b5b1-536523c0b3b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.452791 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a65c8b-1301-44ea-b5b1-536523c0b3b9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.462947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3a0b5-3253-46e8-9166-756df0f46b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaab085a52a4171be0afec37707daca, user_id=48ca95750bea45019bdc0b34b8f445df, role_id=8a020c6e5d94457ca1f453a3531c89b2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.465855 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3a0b5-3253-46e8-9166-756df0f46b80 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.474946 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-27a65c8b-1301-44ea-b5b1-536523c0b3b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:56.476861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 285/570] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:56.482737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a65c8b-1301-44ea-b5b1-536523c0b3b9 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.493294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a65c8b-1301-44ea-b5b1-536523c0b3b9 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.493589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 286/571] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:56 2022] PUT /identity/v3/projects/0eaab085a52a4171be0afec37707daca/users/48ca95750bea45019bdc0b34b8f445df/roles/8a020c6e5d94457ca1f453a3531c89b2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:25:56.546852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9038f40-bcce-480f-8484-75a4bc8e1ba4 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.547179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9038f40-bcce-480f-8484-75a4bc8e1ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.547440 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9038f40-bcce-480f-8484-75a4bc8e1ba4 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.549367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 287/572] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:56.556269 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc361-5196-41d1-830d-70f5eb85d637 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.556633 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc361-5196-41d1-830d-70f5eb85d637 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.556909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc361-5196-41d1-830d-70f5eb85d637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.572995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514fd15-bed3-4454-a7ef-f36af47e2931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.573679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514fd15-bed3-4454-a7ef-f36af47e2931 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.573964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514fd15-bed3-4454-a7ef-f36af47e2931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.574254 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514fd15-bed3-4454-a7ef-f36af47e2931 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.576236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514fd15-bed3-4454-a7ef-f36af47e2931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:56.576236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514fd15-bed3-4454-a7ef-f36af47e2931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.576984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514fd15-bed3-4454-a7ef-f36af47e2931 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.589335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 286/573] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:56.594484 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-13fbc361-5196-41d1-830d-70f5eb85d637 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:56.594734 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514fd15-bed3-4454-a7ef-f36af47e2931 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.595674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-13fbc361-5196-41d1-830d-70f5eb85d637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:56.604726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514fd15-bed3-4454-a7ef-f36af47e2931 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.610052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d8a6-daae-4979-81d9-6410a96fe92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.611006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d8a6-daae-4979-81d9-6410a96fe92d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.611295 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d8a6-daae-4979-81d9-6410a96fe92d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.611570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d8a6-daae-4979-81d9-6410a96fe92d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.625853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 288/574] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:56.626708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d8a6-daae-4979-81d9-6410a96fe92d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.628902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d8a6-daae-4979-81d9-6410a96fe92d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.643582 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-db52d8a6-daae-4979-81d9-6410a96fe92d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:25:56.645140 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 287/575] 10.222.0.79 () {56 vars in 1114 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:56.650629 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbc361-5196-41d1-830d-70f5eb85d637 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.656160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d8a6-daae-4979-81d9-6410a96fe92d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.661140 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbc361-5196-41d1-830d-70f5eb85d637 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.665884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770fda2-7481-4694-a0e8-d03207e8e9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.666605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770fda2-7481-4694-a0e8-d03207e8e9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.666936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770fda2-7481-4694-a0e8-d03207e8e9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.667213 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770fda2-7481-4694-a0e8-d03207e8e9d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.668123 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770fda2-7481-4694-a0e8-d03207e8e9d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:56.668434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770fda2-7481-4694-a0e8-d03207e8e9d0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.669139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d8a6-daae-4979-81d9-6410a96fe92d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.670562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770fda2-7481-4694-a0e8-d03207e8e9d0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.682231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1fdf9-f98d-4319-bc1d-5468d9445892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.682231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1fdf9-f98d-4319-bc1d-5468d9445892 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.682231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1fdf9-f98d-4319-bc1d-5468d9445892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.682231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1fdf9-f98d-4319-bc1d-5468d9445892 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.705653 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 289/576] 10.222.0.79 () {56 vars in 1154 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:56.706078 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1fdf9-f98d-4319-bc1d-5468d9445892 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:56.718287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-eaa1fdf9-f98d-4319-bc1d-5468d9445892 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:25:56.719877 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 288/577] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:56.721633 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770fda2-7481-4694-a0e8-d03207e8e9d0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.729124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1fdf9-f98d-4319-bc1d-5468d9445892 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.733819 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770fda2-7481-4694-a0e8-d03207e8e9d0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.744659 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e3739-36ff-40d2-9cbd-2bb22a38c0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.745525 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e3739-36ff-40d2-9cbd-2bb22a38c0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.745869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e3739-36ff-40d2-9cbd-2bb22a38c0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.746185 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e3739-36ff-40d2-9cbd-2bb22a38c0e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.753781 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1fdf9-f98d-4319-bc1d-5468d9445892 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.766152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612bd37-1dc8-45d0-a75d-dda5a6189b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.766872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612bd37-1dc8-45d0-a75d-dda5a6189b6d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.767391 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612bd37-1dc8-45d0-a75d-dda5a6189b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.768444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e3739-36ff-40d2-9cbd-2bb22a38c0e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.769285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612bd37-1dc8-45d0-a75d-dda5a6189b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.770056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612bd37-1dc8-45d0-a75d-dda5a6189b6d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:56.770390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612bd37-1dc8-45d0-a75d-dda5a6189b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.772015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e3739-36ff-40d2-9cbd-2bb22a38c0e7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.774332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612bd37-1dc8-45d0-a75d-dda5a6189b6d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.784063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 289/578] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:56.791738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612bd37-1dc8-45d0-a75d-dda5a6189b6d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.800433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-981e3739-36ff-40d2-9cbd-2bb22a38c0e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:56.801720 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612bd37-1dc8-45d0-a75d-dda5a6189b6d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.801969 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 290/579] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:56.807544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e3739-36ff-40d2-9cbd-2bb22a38c0e7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.810950 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd244b8-b18a-4f79-be30-2bacb28514f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.811948 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd244b8-b18a-4f79-be30-2bacb28514f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.812384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd244b8-b18a-4f79-be30-2bacb28514f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.812761 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd244b8-b18a-4f79-be30-2bacb28514f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.818431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e3739-36ff-40d2-9cbd-2bb22a38c0e7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.825268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38880dad-70d6-4f54-a81f-46e87af56900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.826492 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38880dad-70d6-4f54-a81f-46e87af56900 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.827399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd244b8-b18a-4f79-be30-2bacb28514f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.827649 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38880dad-70d6-4f54-a81f-46e87af56900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.828086 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38880dad-70d6-4f54-a81f-46e87af56900 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.829004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38880dad-70d6-4f54-a81f-46e87af56900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:56.829465 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38880dad-70d6-4f54-a81f-46e87af56900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.829850 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd244b8-b18a-4f79-be30-2bacb28514f6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.831447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38880dad-70d6-4f54-a81f-46e87af56900 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.845724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 291/580] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:56.851159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38880dad-70d6-4f54-a81f-46e87af56900 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.851834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-bfd244b8-b18a-4f79-be30-2bacb28514f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:56.853376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 290/581] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:56.861687 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd244b8-b18a-4f79-be30-2bacb28514f6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.863529 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38880dad-70d6-4f54-a81f-46e87af56900 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.868481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2555ff0-001a-484b-af12-f6588fa720ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.869271 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2555ff0-001a-484b-af12-f6588fa720ea admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.869700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2555ff0-001a-484b-af12-f6588fa720ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.870071 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2555ff0-001a-484b-af12-f6588fa720ea admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.872382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd244b8-b18a-4f79-be30-2bacb28514f6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.879165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288e63e-bfc5-4ea0-a18c-052b7b485df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.879757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e63e-bfc5-4ea0-a18c-052b7b485df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.879861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2555ff0-001a-484b-af12-f6588fa720ea admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.880053 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e63e-bfc5-4ea0-a18c-052b7b485df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.880307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e63e-bfc5-4ea0-a18c-052b7b485df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.881023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288e63e-bfc5-4ea0-a18c-052b7b485df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:56.881328 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288e63e-bfc5-4ea0-a18c-052b7b485df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.881804 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2555ff0-001a-484b-af12-f6588fa720ea admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.882958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288e63e-bfc5-4ea0-a18c-052b7b485df0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.895212 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 291/582] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:56.896191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-b2555ff0-001a-484b-af12-f6588fa720ea admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:25:56.896473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76640bf8-29dc-4837-8850-601a6faf19e1 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.896764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76640bf8-29dc-4837-8850-601a6faf19e1 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.897034 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76640bf8-29dc-4837-8850-601a6faf19e1 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.897624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 292/583] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:56.902657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2555ff0-001a-484b-af12-f6588fa720ea admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.903311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 292/584] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:56.905055 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76640bf8-29dc-4837-8850-601a6faf19e1 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.914517 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2555ff0-001a-484b-af12-f6588fa720ea admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.917250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76640bf8-29dc-4837-8850-601a6faf19e1 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.919961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61525d3c-870b-4ef0-a2c3-bb09d93d5859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.921238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61525d3c-870b-4ef0-a2c3-bb09d93d5859 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.921565 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61525d3c-870b-4ef0-a2c3-bb09d93d5859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.921669 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb47d1-a739-4bb3-b47b-ac3327b8de96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.921858 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61525d3c-870b-4ef0-a2c3-bb09d93d5859 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.922341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb47d1-a739-4bb3-b47b-ac3327b8de96 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.922627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb47d1-a739-4bb3-b47b-ac3327b8de96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.922903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb47d1-a739-4bb3-b47b-ac3327b8de96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.923688 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb47d1-a739-4bb3-b47b-ac3327b8de96 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:56.923997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb47d1-a739-4bb3-b47b-ac3327b8de96 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.925904 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb47d1-a739-4bb3-b47b-ac3327b8de96 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.930164 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61525d3c-870b-4ef0-a2c3-bb09d93d5859 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.932345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61525d3c-870b-4ef0-a2c3-bb09d93d5859 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.938958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 293/585] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:56.940203 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd6dd4-cadd-46d6-95b5-3e59c51d6cc9 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.940489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd6dd4-cadd-46d6-95b5-3e59c51d6cc9 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.940761 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd6dd4-cadd-46d6-95b5-3e59c51d6cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.948907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-61525d3c-870b-4ef0-a2c3-bb09d93d5859 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 01:25:56.950346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 293/586] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:56.951086 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61525d3c-870b-4ef0-a2c3-bb09d93d5859 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.962539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-26bd6dd4-cadd-46d6-95b5-3e59c51d6cc9 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:56.963791 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-26bd6dd4-cadd-46d6-95b5-3e59c51d6cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:56.965220 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61525d3c-870b-4ef0-a2c3-bb09d93d5859 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.969850 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1b7ff-2b0d-443a-820c-ea83eaa66dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.970746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1b7ff-2b0d-443a-820c-ea83eaa66dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.971026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1b7ff-2b0d-443a-820c-ea83eaa66dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.971295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1b7ff-2b0d-443a-820c-ea83eaa66dc1 admin admin] PATH_INFO: `/v3/projects/0eaab085a52a4171be0afec37707daca/users/333ec5b3842b432a99bc265abbe7fa58/roles/8a020c6e5d94457ca1f453a3531c89b2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.972368 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 294/587] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:56.978473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd6dd4-cadd-46d6-95b5-3e59c51d6cc9 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.986322 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1b7ff-2b0d-443a-820c-ea83eaa66dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaab085a52a4171be0afec37707daca, user_id=333ec5b3842b432a99bc265abbe7fa58, role_id=8a020c6e5d94457ca1f453a3531c89b2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.989026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1b7ff-2b0d-443a-820c-ea83eaa66dc1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.992605 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd6dd4-cadd-46d6-95b5-3e59c51d6cc9 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.005852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 294/588] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:56 2022] PUT /identity/v3/projects/0eaab085a52a4171be0afec37707daca/users/333ec5b3842b432a99bc265abbe7fa58/roles/8a020c6e5d94457ca1f453a3531c89b2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:57.007326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16165fe-f75f-481e-8717-dc46bd5e82b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.008010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16165fe-f75f-481e-8717-dc46bd5e82b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.008292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16165fe-f75f-481e-8717-dc46bd5e82b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.008566 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16165fe-f75f-481e-8717-dc46bd5e82b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.009412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16165fe-f75f-481e-8717-dc46bd5e82b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:57.009716 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16165fe-f75f-481e-8717-dc46bd5e82b4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.011662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16165fe-f75f-481e-8717-dc46bd5e82b4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.026448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1b7ff-2b0d-443a-820c-ea83eaa66dc1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.039187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 295/589] 10.222.0.79 () {56 vars in 1160 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:57.044526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16165fe-f75f-481e-8717-dc46bd5e82b4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.056103 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16165fe-f75f-481e-8717-dc46bd5e82b4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.113169 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1b7ff-2b0d-443a-820c-ea83eaa66dc1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.119683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85713d-5acc-4e0e-b6c6-1c8001ef00d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.121292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85713d-5acc-4e0e-b6c6-1c8001ef00d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.121720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85713d-5acc-4e0e-b6c6-1c8001ef00d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.122162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85713d-5acc-4e0e-b6c6-1c8001ef00d8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.134917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b36bf-1f8b-41d3-9bb1-23830bd705df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.135878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b36bf-1f8b-41d3-9bb1-23830bd705df admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.136258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b36bf-1f8b-41d3-9bb1-23830bd705df admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.136632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b36bf-1f8b-41d3-9bb1-23830bd705df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.138610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85713d-5acc-4e0e-b6c6-1c8001ef00d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:57.148373 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b36bf-1f8b-41d3-9bb1-23830bd705df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.148576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-ac85713d-5acc-4e0e-b6c6-1c8001ef00d8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:25:57.149924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 295/590] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:57.150619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b36bf-1f8b-41d3-9bb1-23830bd705df admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.157357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85713d-5acc-4e0e-b6c6-1c8001ef00d8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.174257 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85713d-5acc-4e0e-b6c6-1c8001ef00d8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.184591 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-636b36bf-1f8b-41d3-9bb1-23830bd705df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:57.189059 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5aeca-1f64-4577-8c49-e402035f898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.190040 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5aeca-1f64-4577-8c49-e402035f898b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.190549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5aeca-1f64-4577-8c49-e402035f898b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.191020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5aeca-1f64-4577-8c49-e402035f898b admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.192057 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5aeca-1f64-4577-8c49-e402035f898b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:57.192565 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5aeca-1f64-4577-8c49-e402035f898b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.194476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5aeca-1f64-4577-8c49-e402035f898b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.198886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 296/591] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:57.205300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b36bf-1f8b-41d3-9bb1-23830bd705df admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.213538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 296/592] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:57.219078 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b36bf-1f8b-41d3-9bb1-23830bd705df admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.224087 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553292f0-3692-496c-bbeb-6d81e4088bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.225523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5aeca-1f64-4577-8c49-e402035f898b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.234944 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553292f0-3692-496c-bbeb-6d81e4088bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.236525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553292f0-3692-496c-bbeb-6d81e4088bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.237935 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5aeca-1f64-4577-8c49-e402035f898b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.238502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553292f0-3692-496c-bbeb-6d81e4088bb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.239481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553292f0-3692-496c-bbeb-6d81e4088bb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:57.240010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553292f0-3692-496c-bbeb-6d81e4088bb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.242610 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553292f0-3692-496c-bbeb-6d81e4088bb5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.254239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f594302-8111-4252-8b2b-a69b3ae81ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.255406 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f594302-8111-4252-8b2b-a69b3ae81ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.255940 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f594302-8111-4252-8b2b-a69b3ae81ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.256409 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f594302-8111-4252-8b2b-a69b3ae81ffe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.268134 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 297/593] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:57.269439 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f594302-8111-4252-8b2b-a69b3ae81ffe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.271536 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f594302-8111-4252-8b2b-a69b3ae81ffe admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.273788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553292f0-3692-496c-bbeb-6d81e4088bb5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.283650 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553292f0-3692-496c-bbeb-6d81e4088bb5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.291679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c9ea5-f307-4731-860b-46709a0b894d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.292807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c9ea5-f307-4731-860b-46709a0b894d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.293311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c9ea5-f307-4731-860b-46709a0b894d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.293847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c9ea5-f307-4731-860b-46709a0b894d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.301436 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-5f594302-8111-4252-8b2b-a69b3ae81ffe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:57.308441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c9ea5-f307-4731-860b-46709a0b894d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.310752 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c9ea5-f307-4731-860b-46709a0b894d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.311980 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 297/594] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:57.317921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f594302-8111-4252-8b2b-a69b3ae81ffe admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.328334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-f51c9ea5-f307-4731-860b-46709a0b894d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:25:57.330046 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 298/595] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:57.332408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f594302-8111-4252-8b2b-a69b3ae81ffe admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.342266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c9ea5-f307-4731-860b-46709a0b894d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.345988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c743584-f6ac-4aa5-be50-95ce6e9a2e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.347271 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c743584-f6ac-4aa5-be50-95ce6e9a2e1d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.348748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c743584-f6ac-4aa5-be50-95ce6e9a2e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.349162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c743584-f6ac-4aa5-be50-95ce6e9a2e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.350051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c743584-f6ac-4aa5-be50-95ce6e9a2e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:57.351171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c743584-f6ac-4aa5-be50-95ce6e9a2e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.353398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c743584-f6ac-4aa5-be50-95ce6e9a2e1d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.365893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c9ea5-f307-4731-860b-46709a0b894d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.372929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934175e3-4acb-4a72-847f-3bb6b188637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.375126 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934175e3-4acb-4a72-847f-3bb6b188637c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.375674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934175e3-4acb-4a72-847f-3bb6b188637c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.376992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934175e3-4acb-4a72-847f-3bb6b188637c admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.377964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934175e3-4acb-4a72-847f-3bb6b188637c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:57.382313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 298/596] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:57.382846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934175e3-4acb-4a72-847f-3bb6b188637c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.385007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934175e3-4acb-4a72-847f-3bb6b188637c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.389775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c743584-f6ac-4aa5-be50-95ce6e9a2e1d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.404822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c743584-f6ac-4aa5-be50-95ce6e9a2e1d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.412031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72f591-0f86-4c37-9b88-1589f1c86cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.412994 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f591-0f86-4c37-9b88-1589f1c86cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.413453 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f591-0f86-4c37-9b88-1589f1c86cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.413865 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f591-0f86-4c37-9b88-1589f1c86cc7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.419396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 299/597] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:57.422506 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934175e3-4acb-4a72-847f-3bb6b188637c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.428087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72f591-0f86-4c37-9b88-1589f1c86cc7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.430356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72f591-0f86-4c37-9b88-1589f1c86cc7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.444613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934175e3-4acb-4a72-847f-3bb6b188637c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.445599 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-fd72f591-0f86-4c37-9b88-1589f1c86cc7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 01:25:57.446962 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 299/598] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:57.452840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72f591-0f86-4c37-9b88-1589f1c86cc7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.463060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72f591-0f86-4c37-9b88-1589f1c86cc7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.468114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bf172-869f-4463-8f50-0db9b6b95875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.468287 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30860523-0de1-4450-82bb-58ef4f7fff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.469210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bf172-869f-4463-8f50-0db9b6b95875 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.469346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30860523-0de1-4450-82bb-58ef4f7fff33 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.469680 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bf172-869f-4463-8f50-0db9b6b95875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.469888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30860523-0de1-4450-82bb-58ef4f7fff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.470131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bf172-869f-4463-8f50-0db9b6b95875 admin admin] PATH_INFO: `/v3/projects/0eaab085a52a4171be0afec37707daca/users/3f00b174c88547e2ab799d89a50d5b6a/roles/8a020c6e5d94457ca1f453a3531c89b2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.470479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30860523-0de1-4450-82bb-58ef4f7fff33 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.471472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30860523-0de1-4450-82bb-58ef4f7fff33 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:57.471946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30860523-0de1-4450-82bb-58ef4f7fff33 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.474255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30860523-0de1-4450-82bb-58ef4f7fff33 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.503598 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bf172-869f-4463-8f50-0db9b6b95875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaab085a52a4171be0afec37707daca, user_id=3f00b174c88547e2ab799d89a50d5b6a, role_id=8a020c6e5d94457ca1f453a3531c89b2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.512478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 300/599] 10.222.0.79 () {56 vars in 1156 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:57.513586 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bf172-869f-4463-8f50-0db9b6b95875 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.519503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30860523-0de1-4450-82bb-58ef4f7fff33 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.534260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30860523-0de1-4450-82bb-58ef4f7fff33 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.543140 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 300/600] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:25:57 2022] PUT /identity/v3/projects/0eaab085a52a4171be0afec37707daca/users/3f00b174c88547e2ab799d89a50d5b6a/roles/8a020c6e5d94457ca1f453a3531c89b2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:25:57.596759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc76b0c-d778-4004-a36b-917d0237ff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.597566 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc76b0c-d778-4004-a36b-917d0237ff3b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.597945 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc76b0c-d778-4004-a36b-917d0237ff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.598342 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc76b0c-d778-4004-a36b-917d0237ff3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.607504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc76b0c-d778-4004-a36b-917d0237ff3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.609608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc76b0c-d778-4004-a36b-917d0237ff3b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.620025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 301/601] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:57.626311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bf172-869f-4463-8f50-0db9b6b95875 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.636907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bf172-869f-4463-8f50-0db9b6b95875 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.642310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9349c-38aa-400c-b618-0e16597cc130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.643229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9349c-38aa-400c-b618-0e16597cc130 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.643606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9349c-38aa-400c-b618-0e16597cc130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.643993 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9349c-38aa-400c-b618-0e16597cc130 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.655418 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9349c-38aa-400c-b618-0e16597cc130 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.657450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9349c-38aa-400c-b618-0e16597cc130 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.676656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-29e9349c-38aa-400c-b618-0e16597cc130 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:57.678075 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 301/602] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:57.683958 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc76b0c-d778-4004-a36b-917d0237ff3b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.695195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc76b0c-d778-4004-a36b-917d0237ff3b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.700012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb92399-73bb-4344-b187-95d5f0ddb07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.700803 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92399-73bb-4344-b187-95d5f0ddb07f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.701199 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92399-73bb-4344-b187-95d5f0ddb07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.701565 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92399-73bb-4344-b187-95d5f0ddb07f admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.702979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb92399-73bb-4344-b187-95d5f0ddb07f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:57.703444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb92399-73bb-4344-b187-95d5f0ddb07f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.705207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb92399-73bb-4344-b187-95d5f0ddb07f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.717987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 302/603] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:57.723620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9349c-38aa-400c-b618-0e16597cc130 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.734193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9349c-38aa-400c-b618-0e16597cc130 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.738926 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77796aa8-fe50-490c-b15e-6d08e7383d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.739893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77796aa8-fe50-490c-b15e-6d08e7383d27 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.740263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77796aa8-fe50-490c-b15e-6d08e7383d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.740629 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77796aa8-fe50-490c-b15e-6d08e7383d27 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.748380 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77796aa8-fe50-490c-b15e-6d08e7383d27 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.751397 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77796aa8-fe50-490c-b15e-6d08e7383d27 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.766441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-77796aa8-fe50-490c-b15e-6d08e7383d27 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:25:57.768085 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 302/604] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:57.773689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb92399-73bb-4344-b187-95d5f0ddb07f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.783838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb92399-73bb-4344-b187-95d5f0ddb07f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.788530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7519864-03e1-4a87-8b03-67704823944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.789400 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7519864-03e1-4a87-8b03-67704823944d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.789783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7519864-03e1-4a87-8b03-67704823944d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.790187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7519864-03e1-4a87-8b03-67704823944d admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.791178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7519864-03e1-4a87-8b03-67704823944d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:57.791592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7519864-03e1-4a87-8b03-67704823944d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.793635 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7519864-03e1-4a87-8b03-67704823944d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.807354 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 303/605] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:57.814108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77796aa8-fe50-490c-b15e-6d08e7383d27 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:57.825442 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77796aa8-fe50-490c-b15e-6d08e7383d27 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:57.830767 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a9d2d-ce84-417b-ae5e-198d62b25acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:57.831536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a9d2d-ce84-417b-ae5e-198d62b25acd admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:57.831922 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a9d2d-ce84-417b-ae5e-198d62b25acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:57.832299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a9d2d-ce84-417b-ae5e-198d62b25acd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:57.833287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a9d2d-ce84-417b-ae5e-198d62b25acd admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=0cb0a0d56f0049b19ba22e0dd041897e) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:57.833742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a9d2d-ce84-417b-ae5e-198d62b25acd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:57.835872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a9d2d-ce84-417b-ae5e-198d62b25acd admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:57.842794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 303/606] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:25:57 2022] GET /identity/v3/role_assignments?user.id=0cb0a0d56f0049b19ba22e0dd041897e&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:59.216614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1f9c-b915-45da-a654-ba424bbafc99 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.216614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1f9c-b915-45da-a654-ba424bbafc99 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.216614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1f9c-b915-45da-a654-ba424bbafc99 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.218001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 304/607] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:59.224190 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00ad62-109f-42da-b2c7-46d6d6734748 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.225126 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00ad62-109f-42da-b2c7-46d6d6734748 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.225607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00ad62-109f-42da-b2c7-46d6d6734748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.251143 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-be00ad62-109f-42da-b2c7-46d6d6734748 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:59.252627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-be00ad62-109f-42da-b2c7-46d6d6734748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:59.267555 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 304/608] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:25:59.315654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1f9c-b915-45da-a654-ba424bbafc99 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.333148 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1f9c-b915-45da-a654-ba424bbafc99 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.344257 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626e71f-dfa0-4f4e-8074-f3679e5a4594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.345359 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626e71f-dfa0-4f4e-8074-f3679e5a4594 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.345921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626e71f-dfa0-4f4e-8074-f3679e5a4594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.346433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626e71f-dfa0-4f4e-8074-f3679e5a4594 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.360454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626e71f-dfa0-4f4e-8074-f3679e5a4594 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:59.367498 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-f626e71f-dfa0-4f4e-8074-f3679e5a4594 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:25:59.368876 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 305/609] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:59.375127 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00ad62-109f-42da-b2c7-46d6d6734748 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.387003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00ad62-109f-42da-b2c7-46d6d6734748 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.391970 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee25e2-f22a-44f0-a489-2fbd305f70ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.392864 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee25e2-f22a-44f0-a489-2fbd305f70ec admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.393343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee25e2-f22a-44f0-a489-2fbd305f70ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.393818 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee25e2-f22a-44f0-a489-2fbd305f70ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.394802 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee25e2-f22a-44f0-a489-2fbd305f70ec admin admin] RBAC: Adding query filter params (name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:59.395324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee25e2-f22a-44f0-a489-2fbd305f70ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.397104 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee25e2-f22a-44f0-a489-2fbd305f70ec admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.409827 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 305/610] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:59.415385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626e71f-dfa0-4f4e-8074-f3679e5a4594 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.431135 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626e71f-dfa0-4f4e-8074-f3679e5a4594 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.438819 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1c650-46fa-43d5-9234-be41ca566aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.439871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1c650-46fa-43d5-9234-be41ca566aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.440356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1c650-46fa-43d5-9234-be41ca566aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.440847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1c650-46fa-43d5-9234-be41ca566aa2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.452241 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1c650-46fa-43d5-9234-be41ca566aa2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.454386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1c650-46fa-43d5-9234-be41ca566aa2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.462385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de810bc-bf0a-445c-9b10-a220fa29cc95 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.462677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de810bc-bf0a-445c-9b10-a220fa29cc95 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.462962 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de810bc-bf0a-445c-9b10-a220fa29cc95 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.464982 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 306/611] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:59.470347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae063-2856-4104-8c58-f436f7163951 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.470635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae063-2856-4104-8c58-f436f7163951 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.470909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae063-2856-4104-8c58-f436f7163951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.476377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-01f1c650-46fa-43d5-9234-be41ca566aa2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:59.477738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 306/612] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:59.483876 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1c650-46fa-43d5-9234-be41ca566aa2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.500704 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1c650-46fa-43d5-9234-be41ca566aa2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.505633 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-890ae063-2856-4104-8c58-f436f7163951 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:59.507854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-890ae063-2856-4104-8c58-f436f7163951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:59.514699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee87b4-2d77-433d-b142-3e898026454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.515589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee87b4-2d77-433d-b142-3e898026454b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.516050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee87b4-2d77-433d-b142-3e898026454b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.516489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee87b4-2d77-433d-b142-3e898026454b admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.517381 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee87b4-2d77-433d-b142-3e898026454b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:59.517939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee87b4-2d77-433d-b142-3e898026454b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.520097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee87b4-2d77-433d-b142-3e898026454b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.531393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 307/613] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:59.536811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 307/614] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:59.547209 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ae063-2856-4104-8c58-f436f7163951 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.557205 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee87b4-2d77-433d-b142-3e898026454b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.558338 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ae063-2856-4104-8c58-f436f7163951 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.570152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b4c7e-21ee-4186-a19d-ba8650c80cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.571216 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b4c7e-21ee-4186-a19d-ba8650c80cda admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.571666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b4c7e-21ee-4186-a19d-ba8650c80cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.572107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b4c7e-21ee-4186-a19d-ba8650c80cda admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.575113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee87b4-2d77-433d-b142-3e898026454b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.583919 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b4c7e-21ee-4186-a19d-ba8650c80cda admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.586645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b4c7e-21ee-4186-a19d-ba8650c80cda admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.590282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764a3b4-6f53-4c84-9072-356f412147ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.591283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764a3b4-6f53-4c84-9072-356f412147ab admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.591770 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764a3b4-6f53-4c84-9072-356f412147ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.592237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764a3b4-6f53-4c84-9072-356f412147ab admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.603003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764a3b4-6f53-4c84-9072-356f412147ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:59.610300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-917b4c7e-21ee-4186-a19d-ba8650c80cda admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 01:25:59.610982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-1764a3b4-6f53-4c84-9072-356f412147ab admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:25:59.617058 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 308/615] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:59.618552 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764a3b4-6f53-4c84-9072-356f412147ab admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.618660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 308/616] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:59.624299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b4c7e-21ee-4186-a19d-ba8650c80cda admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.633660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764a3b4-6f53-4c84-9072-356f412147ab admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.641095 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b4c7e-21ee-4186-a19d-ba8650c80cda admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.643255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430fd78-1d6f-470f-8e59-472273f726b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.644097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430fd78-1d6f-470f-8e59-472273f726b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.644553 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430fd78-1d6f-470f-8e59-472273f726b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.645771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430fd78-1d6f-470f-8e59-472273f726b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.647610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430fd78-1d6f-470f-8e59-472273f726b7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:59.648539 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430fd78-1d6f-470f-8e59-472273f726b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.651712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430fd78-1d6f-470f-8e59-472273f726b7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.652458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ac72a-8598-43f6-a053-ee5a4e183ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.653865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ac72a-8598-43f6-a053-ee5a4e183ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.655059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ac72a-8598-43f6-a053-ee5a4e183ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.655504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ac72a-8598-43f6-a053-ee5a4e183ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.656909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ac72a-8598-43f6-a053-ee5a4e183ac8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:59.658282 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ac72a-8598-43f6-a053-ee5a4e183ac8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.662473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ac72a-8598-43f6-a053-ee5a4e183ac8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.677479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 309/617] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:59.680015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430fd78-1d6f-470f-8e59-472273f726b7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.697612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430fd78-1d6f-470f-8e59-472273f726b7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.701386 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 309/618] 10.222.0.79 () {56 vars in 1158 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:59.704903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce3c41-1776-4533-847c-7c7e00ea99f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.705914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce3c41-1776-4533-847c-7c7e00ea99f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.707239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ac72a-8598-43f6-a053-ee5a4e183ac8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.707971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce3c41-1776-4533-847c-7c7e00ea99f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.708818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce3c41-1776-4533-847c-7c7e00ea99f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.725648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce3c41-1776-4533-847c-7c7e00ea99f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.727870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce3c41-1776-4533-847c-7c7e00ea99f8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.728423 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ac72a-8598-43f6-a053-ee5a4e183ac8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.739757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7abadf-f33c-4b15-93d2-a37f5f8408b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.740419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7abadf-f33c-4b15-93d2-a37f5f8408b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.740703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7abadf-f33c-4b15-93d2-a37f5f8408b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.740978 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7abadf-f33c-4b15-93d2-a37f5f8408b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.746785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-edce3c41-1776-4533-847c-7c7e00ea99f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:59.753356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 310/619] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:25:59.754707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce3c41-1776-4533-847c-7c7e00ea99f8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.762854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7abadf-f33c-4b15-93d2-a37f5f8408b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.766139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7abadf-f33c-4b15-93d2-a37f5f8408b3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.768295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce3c41-1776-4533-847c-7c7e00ea99f8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.777875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a4564-ac89-4fe8-8617-4d2e6d2777da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.779761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a4564-ac89-4fe8-8617-4d2e6d2777da admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.780236 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a4564-ac89-4fe8-8617-4d2e6d2777da admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.780778 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a4564-ac89-4fe8-8617-4d2e6d2777da admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.781691 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a4564-ac89-4fe8-8617-4d2e6d2777da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:59.782166 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a4564-ac89-4fe8-8617-4d2e6d2777da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.783955 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a4564-ac89-4fe8-8617-4d2e6d2777da admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.784254 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 310/620] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:25:59.785690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d81ca4-da87-4d32-9717-0b157f27cba7 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.785981 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d81ca4-da87-4d32-9717-0b157f27cba7 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.786332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d81ca4-da87-4d32-9717-0b157f27cba7 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.788220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 311/621] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:59.792733 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d81ca4-da87-4d32-9717-0b157f27cba7 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.798161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 311/622] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:59.803699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4778e0e-b65a-4834-b24d-d7df899d93ce None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.804268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4778e0e-b65a-4834-b24d-d7df899d93ce None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.804784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4778e0e-b65a-4834-b24d-d7df899d93ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.805563 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d81ca4-da87-4d32-9717-0b157f27cba7 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.810432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e0b96-8df1-402b-851d-e38aceb26c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.811990 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e0b96-8df1-402b-851d-e38aceb26c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.812343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e0b96-8df1-402b-851d-e38aceb26c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.812729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e0b96-8df1-402b-851d-e38aceb26c5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.827248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e0b96-8df1-402b-851d-e38aceb26c5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.829095 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e0b96-8df1-402b-851d-e38aceb26c5c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.829798 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-d4778e0e-b65a-4834-b24d-d7df899d93ce None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:59.831326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-d4778e0e-b65a-4834-b24d-d7df899d93ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:59.840657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 312/623] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:25:59.841207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4778e0e-b65a-4834-b24d-d7df899d93ce None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.852294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-d79e0b96-8df1-402b-851d-e38aceb26c5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:25:59.853834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 312/624] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:59.853931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4778e0e-b65a-4834-b24d-d7df899d93ce None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.859991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e0b96-8df1-402b-851d-e38aceb26c5c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.863459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc836e-af69-4190-95c1-0fac5ec002e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.864244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc836e-af69-4190-95c1-0fac5ec002e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.864522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc836e-af69-4190-95c1-0fac5ec002e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.864789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc836e-af69-4190-95c1-0fac5ec002e9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.872637 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc836e-af69-4190-95c1-0fac5ec002e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.875520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc836e-af69-4190-95c1-0fac5ec002e9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.880145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e0b96-8df1-402b-851d-e38aceb26c5c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.885171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d432974-6657-4592-b354-555ba13fff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.885829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d432974-6657-4592-b354-555ba13fff19 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.886109 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d432974-6657-4592-b354-555ba13fff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.886415 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d432974-6657-4592-b354-555ba13fff19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.887251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d432974-6657-4592-b354-555ba13fff19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:59.887557 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d432974-6657-4592-b354-555ba13fff19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.889230 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d432974-6657-4592-b354-555ba13fff19 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.890765 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-d0dc836e-af69-4190-95c1-0fac5ec002e9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:25:59.892144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 313/625] 10.222.0.79 () {56 vars in 1114 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:59.892695 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc836e-af69-4190-95c1-0fac5ec002e9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.906933 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc836e-af69-4190-95c1-0fac5ec002e9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.907296 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 313/626] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:25:59.912501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d432974-6657-4592-b354-555ba13fff19 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.915538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fa46b-701e-41e9-b76f-73a635c17bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.916322 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fa46b-701e-41e9-b76f-73a635c17bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.916602 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fa46b-701e-41e9-b76f-73a635c17bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.916874 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fa46b-701e-41e9-b76f-73a635c17bc5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.923212 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d432974-6657-4592-b354-555ba13fff19 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.927913 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739925f-4265-4ca2-9572-74a569c95b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.928568 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739925f-4265-4ca2-9572-74a569c95b79 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.928855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739925f-4265-4ca2-9572-74a569c95b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.929168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fa46b-701e-41e9-b76f-73a635c17bc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:25:59.929271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739925f-4265-4ca2-9572-74a569c95b79 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.930038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739925f-4265-4ca2-9572-74a569c95b79 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:59.930395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739925f-4265-4ca2-9572-74a569c95b79 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.932358 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739925f-4265-4ca2-9572-74a569c95b79 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.937056 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-649fa46b-701e-41e9-b76f-73a635c17bc5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:25:59.942305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 314/627] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:59.943185 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fa46b-701e-41e9-b76f-73a635c17bc5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.954944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fa46b-701e-41e9-b76f-73a635c17bc5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.955964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 314/628] 10.222.0.79 () {56 vars in 1154 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:59.956858 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739925f-4265-4ca2-9572-74a569c95b79 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.964566 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6e341-b633-43fe-a745-fb30adb71e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.965423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6e341-b633-43fe-a745-fb30adb71e57 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.965710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6e341-b633-43fe-a745-fb30adb71e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.965981 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6e341-b633-43fe-a745-fb30adb71e57 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.968034 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739925f-4265-4ca2-9572-74a569c95b79 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.973322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a3b4e-7c7f-4fb6-9a09-6f89eed4aa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.974224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a3b4e-7c7f-4fb6-9a09-6f89eed4aa20 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.974656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a3b4e-7c7f-4fb6-9a09-6f89eed4aa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.974937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a3b4e-7c7f-4fb6-9a09-6f89eed4aa20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.975328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6e341-b633-43fe-a745-fb30adb71e57 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.975707 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a3b4e-7c7f-4fb6-9a09-6f89eed4aa20 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:25:59.976017 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a3b4e-7c7f-4fb6-9a09-6f89eed4aa20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.977588 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6e341-b633-43fe-a745-fb30adb71e57 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.977788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a3b4e-7c7f-4fb6-9a09-6f89eed4aa20 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.988683 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 315/629] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:25:59.989316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a3b4e-7c7f-4fb6-9a09-6f89eed4aa20 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.993279 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-ace6e341-b633-43fe-a745-fb30adb71e57 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:25:59.994705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 315/630] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:25:59.995509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6e341-b633-43fe-a745-fb30adb71e57 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.005556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a3b4e-7c7f-4fb6-9a09-6f89eed4aa20 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.010450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8faf6-542e-44ae-9f2b-2db71de9674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.010752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6e341-b633-43fe-a745-fb30adb71e57 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.011434 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8faf6-542e-44ae-9f2b-2db71de9674c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.011908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8faf6-542e-44ae-9f2b-2db71de9674c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.012315 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8faf6-542e-44ae-9f2b-2db71de9674c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.015739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb364ea2-5896-4b0e-8619-3a0954d66deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.016709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb364ea2-5896-4b0e-8619-3a0954d66deb admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.017088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb364ea2-5896-4b0e-8619-3a0954d66deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.017515 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb364ea2-5896-4b0e-8619-3a0954d66deb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.021664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8faf6-542e-44ae-9f2b-2db71de9674c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.023631 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8faf6-542e-44ae-9f2b-2db71de9674c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.032970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb364ea2-5896-4b0e-8619-3a0954d66deb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.034863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb364ea2-5896-4b0e-8619-3a0954d66deb admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.037824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 316/631] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:26:00.038973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8faf6-542e-44ae-9f2b-2db71de9674c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.053282 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8faf6-542e-44ae-9f2b-2db71de9674c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.057858 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-eb364ea2-5896-4b0e-8619-3a0954d66deb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:00.057968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f5681-6ccd-4549-881c-600fcb1b9611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.058529 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f5681-6ccd-4549-881c-600fcb1b9611 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.058850 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f5681-6ccd-4549-881c-600fcb1b9611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.059136 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f5681-6ccd-4549-881c-600fcb1b9611 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.060112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f5681-6ccd-4549-881c-600fcb1b9611 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.061202 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f5681-6ccd-4549-881c-600fcb1b9611 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.064980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f5681-6ccd-4549-881c-600fcb1b9611 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.065201 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 316/632] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:00.066644 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb364ea2-5896-4b0e-8619-3a0954d66deb admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.076378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 317/633] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:00.077132 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f5681-6ccd-4549-881c-600fcb1b9611 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.078377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb364ea2-5896-4b0e-8619-3a0954d66deb admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.089096 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f5681-6ccd-4549-881c-600fcb1b9611 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.094716 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24bdf7-4686-4357-9173-89c700ad1d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.095520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24bdf7-4686-4357-9173-89c700ad1d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.096125 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24bdf7-4686-4357-9173-89c700ad1d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.096125 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24bdf7-4686-4357-9173-89c700ad1d48 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.102024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4294b-f3f4-40d5-aeee-3071f10fe127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.102857 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4294b-f3f4-40d5-aeee-3071f10fe127 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.103235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4294b-f3f4-40d5-aeee-3071f10fe127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.103583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4294b-f3f4-40d5-aeee-3071f10fe127 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.104438 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4294b-f3f4-40d5-aeee-3071f10fe127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.104763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4294b-f3f4-40d5-aeee-3071f10fe127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.106443 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4294b-f3f4-40d5-aeee-3071f10fe127 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.109775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24bdf7-4686-4357-9173-89c700ad1d48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.111787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24bdf7-4686-4357-9173-89c700ad1d48 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.119239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 318/634] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:00.120133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4294b-f3f4-40d5-aeee-3071f10fe127 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.129261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-af24bdf7-4686-4357-9173-89c700ad1d48 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:00.130824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 317/635] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:00.131651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24bdf7-4686-4357-9173-89c700ad1d48 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.134632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4294b-f3f4-40d5-aeee-3071f10fe127 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.141661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a82f9b-df9f-4cc4-b171-57868d5da725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.142375 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a82f9b-df9f-4cc4-b171-57868d5da725 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.142661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a82f9b-df9f-4cc4-b171-57868d5da725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.142934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a82f9b-df9f-4cc4-b171-57868d5da725 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.143788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a82f9b-df9f-4cc4-b171-57868d5da725 admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=e68b3bc64dc94865a72cea0988fa9c65) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.144070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a82f9b-df9f-4cc4-b171-57868d5da725 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.145909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a82f9b-df9f-4cc4-b171-57868d5da725 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.146497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24bdf7-4686-4357-9173-89c700ad1d48 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.152319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27bd68-2e92-4a7e-be3b-0f2a2da02d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.153015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 319/636] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/role_assignments?user.id=e68b3bc64dc94865a72cea0988fa9c65&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:00.153761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27bd68-2e92-4a7e-be3b-0f2a2da02d3a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.153867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a82f9b-df9f-4cc4-b171-57868d5da725 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.154378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27bd68-2e92-4a7e-be3b-0f2a2da02d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.155425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27bd68-2e92-4a7e-be3b-0f2a2da02d3a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.164708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a82f9b-df9f-4cc4-b171-57868d5da725 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.166165 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27bd68-2e92-4a7e-be3b-0f2a2da02d3a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.168428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27bd68-2e92-4a7e-be3b-0f2a2da02d3a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.169520 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc3425-1f87-4c12-8885-baaa81184296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.170255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc3425-1f87-4c12-8885-baaa81184296 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.170665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc3425-1f87-4c12-8885-baaa81184296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.170940 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc3425-1f87-4c12-8885-baaa81184296 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.171775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc3425-1f87-4c12-8885-baaa81184296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.172083 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc3425-1f87-4c12-8885-baaa81184296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.173831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc3425-1f87-4c12-8885-baaa81184296 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.187092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-7d27bd68-2e92-4a7e-be3b-0f2a2da02d3a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 01:26:00.187612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 320/637] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:00.189029 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 318/638] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:00.196204 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc3425-1f87-4c12-8885-baaa81184296 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.197712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27bd68-2e92-4a7e-be3b-0f2a2da02d3a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.206622 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc3425-1f87-4c12-8885-baaa81184296 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.211207 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d5773-7a5e-4968-a345-162d7f064e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.212058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d5773-7a5e-4968-a345-162d7f064e1d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.212339 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d5773-7a5e-4968-a345-162d7f064e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.212610 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d5773-7a5e-4968-a345-162d7f064e1d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.213710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27bd68-2e92-4a7e-be3b-0f2a2da02d3a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.223721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59212b80-3d8f-4a60-9b0d-bc8a29d51dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.228123 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212b80-3d8f-4a60-9b0d-bc8a29d51dbd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.228408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212b80-3d8f-4a60-9b0d-bc8a29d51dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.228678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212b80-3d8f-4a60-9b0d-bc8a29d51dbd admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.229810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59212b80-3d8f-4a60-9b0d-bc8a29d51dbd admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.230122 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59212b80-3d8f-4a60-9b0d-bc8a29d51dbd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.231100 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d5773-7a5e-4968-a345-162d7f064e1d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.234897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59212b80-3d8f-4a60-9b0d-bc8a29d51dbd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.235201 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d5773-7a5e-4968-a345-162d7f064e1d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.267133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-b90d5773-7a5e-4968-a345-162d7f064e1d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:00.276197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 319/640] 10.222.0.79 () {56 vars in 1158 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:00.276620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 321/640] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:00.280179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59212b80-3d8f-4a60-9b0d-bc8a29d51dbd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.283689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d5773-7a5e-4968-a345-162d7f064e1d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.299700 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d5773-7a5e-4968-a345-162d7f064e1d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.302671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59212b80-3d8f-4a60-9b0d-bc8a29d51dbd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.310874 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd5fb8-caa5-4bce-ad0c-baf31c2541f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.312120 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd5fb8-caa5-4bce-ad0c-baf31c2541f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.312404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd5fb8-caa5-4bce-ad0c-baf31c2541f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.312678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd5fb8-caa5-4bce-ad0c-baf31c2541f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.313710 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8352a8-1bdd-4dea-a172-0eae5e472341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.314433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8352a8-1bdd-4dea-a172-0eae5e472341 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.314707 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8352a8-1bdd-4dea-a172-0eae5e472341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.314976 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8352a8-1bdd-4dea-a172-0eae5e472341 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.317723 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd5fb8-caa5-4bce-ad0c-baf31c2541f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.318044 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd5fb8-caa5-4bce-ad0c-baf31c2541f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.322217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd5fb8-caa5-4bce-ad0c-baf31c2541f0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.334542 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8352a8-1bdd-4dea-a172-0eae5e472341 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.336474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8352a8-1bdd-4dea-a172-0eae5e472341 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.346865 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 320/641] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:00.349327 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a9f02-47d9-4a68-8274-ac83e6d5b2e9 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.350414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a9f02-47d9-4a68-8274-ac83e6d5b2e9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.350414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a9f02-47d9-4a68-8274-ac83e6d5b2e9 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.352131 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 321/642] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:00.352744 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a9f02-47d9-4a68-8274-ac83e6d5b2e9 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.358651 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 322/643] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:26:00.359767 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa1c07-6679-43a4-9b4c-b3e008262087 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.360052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa1c07-6679-43a4-9b4c-b3e008262087 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.360370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa1c07-6679-43a4-9b4c-b3e008262087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.381422 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a9f02-47d9-4a68-8274-ac83e6d5b2e9 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.381624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0efa1c07-6679-43a4-9b4c-b3e008262087 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:00.383055 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0efa1c07-6679-43a4-9b4c-b3e008262087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:00.387058 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c883c-95d8-41a4-8107-d29f07466759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.388054 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c883c-95d8-41a4-8107-d29f07466759 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.388543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c883c-95d8-41a4-8107-d29f07466759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.389190 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c883c-95d8-41a4-8107-d29f07466759 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.390229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c883c-95d8-41a4-8107-d29f07466759 admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=333ec5b3842b432a99bc265abbe7fa58) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.390683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c883c-95d8-41a4-8107-d29f07466759 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.391437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 323/644] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:26:00.392378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa1c07-6679-43a4-9b4c-b3e008262087 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.393105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c883c-95d8-41a4-8107-d29f07466759 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.405895 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa1c07-6679-43a4-9b4c-b3e008262087 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.408658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 322/645] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/role_assignments?user.id=333ec5b3842b432a99bc265abbe7fa58&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 608 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:00.418349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c883c-95d8-41a4-8107-d29f07466759 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.419230 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a816b0-da09-4087-bec2-13c807095f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.420084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a816b0-da09-4087-bec2-13c807095f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.420899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a816b0-da09-4087-bec2-13c807095f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.421162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a816b0-da09-4087-bec2-13c807095f09 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.435643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c883c-95d8-41a4-8107-d29f07466759 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.439259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a816b0-da09-4087-bec2-13c807095f09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.441122 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a816b0-da09-4087-bec2-13c807095f09 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.446906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a226925-8c96-411c-b3b0-6d74898152b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.447717 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a226925-8c96-411c-b3b0-6d74898152b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.448001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a226925-8c96-411c-b3b0-6d74898152b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.448257 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a226925-8c96-411c-b3b0-6d74898152b1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.465225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a226925-8c96-411c-b3b0-6d74898152b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:00.466704 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-32a816b0-da09-4087-bec2-13c807095f09 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:00.472825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 324/646] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:00.474284 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a816b0-da09-4087-bec2-13c807095f09 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.475536 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-7a226925-8c96-411c-b3b0-6d74898152b1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:26:00.477466 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 323/647] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:00.484934 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a226925-8c96-411c-b3b0-6d74898152b1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.489642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a816b0-da09-4087-bec2-13c807095f09 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.497497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a533ab-92d8-4b3e-bd4d-4c7209d36c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.498333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a533ab-92d8-4b3e-bd4d-4c7209d36c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.499327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a533ab-92d8-4b3e-bd4d-4c7209d36c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.499952 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a533ab-92d8-4b3e-bd4d-4c7209d36c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.500806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a533ab-92d8-4b3e-bd4d-4c7209d36c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.501186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a533ab-92d8-4b3e-bd4d-4c7209d36c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.501648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a226925-8c96-411c-b3b0-6d74898152b1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.503076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a533ab-92d8-4b3e-bd4d-4c7209d36c4b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.507585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d5e25-2981-4bc0-a690-dc86601a08a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.508526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d5e25-2981-4bc0-a690-dc86601a08a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.509015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d5e25-2981-4bc0-a690-dc86601a08a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.509516 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d5e25-2981-4bc0-a690-dc86601a08a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.510542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d5e25-2981-4bc0-a690-dc86601a08a4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.511064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d5e25-2981-4bc0-a690-dc86601a08a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.513581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d5e25-2981-4bc0-a690-dc86601a08a4 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.523143 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 325/648] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:00.530369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 324/649] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:00.532506 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a533ab-92d8-4b3e-bd4d-4c7209d36c4b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.535205 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d5e25-2981-4bc0-a690-dc86601a08a4 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.543137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a533ab-92d8-4b3e-bd4d-4c7209d36c4b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.547778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512600f-d5bb-4205-9575-078c82549d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.548232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d5e25-2981-4bc0-a690-dc86601a08a4 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.548635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512600f-d5bb-4205-9575-078c82549d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.548964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512600f-d5bb-4205-9575-078c82549d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.549278 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512600f-d5bb-4205-9575-078c82549d62 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.554587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81700e-204d-4260-b0c9-25f36d9b77c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.555721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81700e-204d-4260-b0c9-25f36d9b77c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.556574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81700e-204d-4260-b0c9-25f36d9b77c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.557056 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81700e-204d-4260-b0c9-25f36d9b77c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.557267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512600f-d5bb-4205-9575-078c82549d62 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.559416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512600f-d5bb-4205-9575-078c82549d62 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.570605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81700e-204d-4260-b0c9-25f36d9b77c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.572798 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81700e-204d-4260-b0c9-25f36d9b77c8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.577573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-a512600f-d5bb-4205-9575-078c82549d62 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:00.579196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 326/650] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:00.586231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512600f-d5bb-4205-9575-078c82549d62 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.596845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-5a81700e-204d-4260-b0c9-25f36d9b77c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:00.598408 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512600f-d5bb-4205-9575-078c82549d62 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.599105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 325/651] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:00.604678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81700e-204d-4260-b0c9-25f36d9b77c8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.607125 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1863a75-2267-40cb-8cf2-52b67be19461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.608098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1863a75-2267-40cb-8cf2-52b67be19461 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.608587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1863a75-2267-40cb-8cf2-52b67be19461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.609116 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1863a75-2267-40cb-8cf2-52b67be19461 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.610137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1863a75-2267-40cb-8cf2-52b67be19461 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.610493 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1863a75-2267-40cb-8cf2-52b67be19461 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.612440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1863a75-2267-40cb-8cf2-52b67be19461 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.616905 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81700e-204d-4260-b0c9-25f36d9b77c8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.623047 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747aab4-2152-4767-a136-dd34ae9d0434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.624520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747aab4-2152-4767-a136-dd34ae9d0434 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.625264 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747aab4-2152-4767-a136-dd34ae9d0434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.625731 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747aab4-2152-4767-a136-dd34ae9d0434 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.626784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747aab4-2152-4767-a136-dd34ae9d0434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.627283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747aab4-2152-4767-a136-dd34ae9d0434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.627990 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 327/652] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:00.629318 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747aab4-2152-4767-a136-dd34ae9d0434 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.635187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1863a75-2267-40cb-8cf2-52b67be19461 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.642499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 326/653] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:00.646224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1863a75-2267-40cb-8cf2-52b67be19461 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.647478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747aab4-2152-4767-a136-dd34ae9d0434 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.650965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63c872-f969-404f-b948-675218a0fe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.651607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63c872-f969-404f-b948-675218a0fe65 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.651888 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63c872-f969-404f-b948-675218a0fe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.652157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63c872-f969-404f-b948-675218a0fe65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.652975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63c872-f969-404f-b948-675218a0fe65 admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=48ca95750bea45019bdc0b34b8f445df) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.653304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63c872-f969-404f-b948-675218a0fe65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.656182 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63c872-f969-404f-b948-675218a0fe65 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.658138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747aab4-2152-4767-a136-dd34ae9d0434 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.663537 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 328/654] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/role_assignments?user.id=48ca95750bea45019bdc0b34b8f445df&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:00.663656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b6c88-c79b-42e9-aa7a-1bbf8de2425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.664328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b6c88-c79b-42e9-aa7a-1bbf8de2425c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.664612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b6c88-c79b-42e9-aa7a-1bbf8de2425c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.664889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b6c88-c79b-42e9-aa7a-1bbf8de2425c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.679992 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b6c88-c79b-42e9-aa7a-1bbf8de2425c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.682267 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b6c88-c79b-42e9-aa7a-1bbf8de2425c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.698060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-ac8b6c88-c79b-42e9-aa7a-1bbf8de2425c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 01:26:00.699817 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 327/655] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:00.706051 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63c872-f969-404f-b948-675218a0fe65 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.721561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63c872-f969-404f-b948-675218a0fe65 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.729311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad35da-b6f0-4c05-b31d-0ca5cc46464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.729675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad35da-b6f0-4c05-b31d-0ca5cc46464d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.731160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad35da-b6f0-4c05-b31d-0ca5cc46464d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.731160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad35da-b6f0-4c05-b31d-0ca5cc46464d admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.731160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad35da-b6f0-4c05-b31d-0ca5cc46464d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.731415 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad35da-b6f0-4c05-b31d-0ca5cc46464d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.733380 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad35da-b6f0-4c05-b31d-0ca5cc46464d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.757247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 329/656] 10.222.0.79 () {56 vars in 1156 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:00.763007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b6c88-c79b-42e9-aa7a-1bbf8de2425c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.774915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b6c88-c79b-42e9-aa7a-1bbf8de2425c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.781662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b144f4-f8ba-44fa-b07a-159bdbf5d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.782613 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b144f4-f8ba-44fa-b07a-159bdbf5d152 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.782903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b144f4-f8ba-44fa-b07a-159bdbf5d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.783178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b144f4-f8ba-44fa-b07a-159bdbf5d152 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.797042 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b144f4-f8ba-44fa-b07a-159bdbf5d152 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.799133 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b144f4-f8ba-44fa-b07a-159bdbf5d152 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.818170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-01b144f4-f8ba-44fa-b07a-159bdbf5d152 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:00.819446 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 328/657] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:00.825196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad35da-b6f0-4c05-b31d-0ca5cc46464d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.839602 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad35da-b6f0-4c05-b31d-0ca5cc46464d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.850747 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c6c6a-6501-45ca-829f-16efe0e65e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.851428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c6c6a-6501-45ca-829f-16efe0e65e6c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.851707 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c6c6a-6501-45ca-829f-16efe0e65e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.851977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c6c6a-6501-45ca-829f-16efe0e65e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.852717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c6c6a-6501-45ca-829f-16efe0e65e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.853019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c6c6a-6501-45ca-829f-16efe0e65e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.854669 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c6c6a-6501-45ca-829f-16efe0e65e6c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.874184 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 330/658] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:00.881013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b144f4-f8ba-44fa-b07a-159bdbf5d152 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.894015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b144f4-f8ba-44fa-b07a-159bdbf5d152 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.900590 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0b2c8-f9a5-4e26-9c53-22bc7b8b7e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.901548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b2c8-f9a5-4e26-9c53-22bc7b8b7e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.901976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b2c8-f9a5-4e26-9c53-22bc7b8b7e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.902416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b2c8-f9a5-4e26-9c53-22bc7b8b7e51 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.910700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0b2c8-f9a5-4e26-9c53-22bc7b8b7e51 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.912932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d281aa6-c794-4490-b062-f164f06798cf None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.913382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d281aa6-c794-4490-b062-f164f06798cf None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.913800 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d281aa6-c794-4490-b062-f164f06798cf None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.915012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0b2c8-f9a5-4e26-9c53-22bc7b8b7e51 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.916373 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 331/659] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:00.922954 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7cf67-235b-4c4a-88ad-0b74ce8665cb None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.923520 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7cf67-235b-4c4a-88ad-0b74ce8665cb None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.923997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7cf67-235b-4c4a-88ad-0b74ce8665cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.930787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-f3d0b2c8-f9a5-4e26-9c53-22bc7b8b7e51 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:00.932208 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 329/660] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:00.938161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0b2c8-f9a5-4e26-9c53-22bc7b8b7e51 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.945293 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-46e7cf67-235b-4c4a-88ad-0b74ce8665cb None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:00.946779 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-46e7cf67-235b-4c4a-88ad-0b74ce8665cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:00.949675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0b2c8-f9a5-4e26-9c53-22bc7b8b7e51 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.955657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a73ca-742f-4e26-ac8f-e2df70439c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:00.956313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a73ca-742f-4e26-ac8f-e2df70439c95 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:00.956671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a73ca-742f-4e26-ac8f-e2df70439c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:00.956877 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a73ca-742f-4e26-ac8f-e2df70439c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:00.957074 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 332/661] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:26:00.960409 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a73ca-742f-4e26-ac8f-e2df70439c95 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:00.960409 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a73ca-742f-4e26-ac8f-e2df70439c95 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:00.960409 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a73ca-742f-4e26-ac8f-e2df70439c95 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:00.978868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 330/662] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:00.982128 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7cf67-235b-4c4a-88ad-0b74ce8665cb None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.985317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a73ca-742f-4e26-ac8f-e2df70439c95 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:00.992729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7cf67-235b-4c4a-88ad-0b74ce8665cb None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:00.997068 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a73ca-742f-4e26-ac8f-e2df70439c95 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.000696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb082ca1-edc9-4ed5-b21d-704cd19dd307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.001679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb082ca1-edc9-4ed5-b21d-704cd19dd307 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.001973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb082ca1-edc9-4ed5-b21d-704cd19dd307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.002270 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb082ca1-edc9-4ed5-b21d-704cd19dd307 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.004794 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204c68b-ed24-48a5-aafc-8d2f820f765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.005958 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204c68b-ed24-48a5-aafc-8d2f820f765a admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.006480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204c68b-ed24-48a5-aafc-8d2f820f765a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.006759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204c68b-ed24-48a5-aafc-8d2f820f765a admin admin] PATH_INFO: `/v3/projects/0eaab085a52a4171be0afec37707daca/users/0cb0a0d56f0049b19ba22e0dd041897e/roles/8a020c6e5d94457ca1f453a3531c89b2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.016848 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb082ca1-edc9-4ed5-b21d-704cd19dd307 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:01.023063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204c68b-ed24-48a5-aafc-8d2f820f765a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaab085a52a4171be0afec37707daca, user_id=0cb0a0d56f0049b19ba22e0dd041897e, role_id=8a020c6e5d94457ca1f453a3531c89b2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.024932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-fb082ca1-edc9-4ed5-b21d-704cd19dd307 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:26:01.026156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 333/663] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:26:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:01.027998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204c68b-ed24-48a5-aafc-8d2f820f765a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.032351 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb082ca1-edc9-4ed5-b21d-704cd19dd307 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:01.042164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb082ca1-edc9-4ed5-b21d-704cd19dd307 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.044615 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 331/664] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:26:00 2022] PUT /identity/v3/projects/0eaab085a52a4171be0afec37707daca/users/0cb0a0d56f0049b19ba22e0dd041897e/roles/8a020c6e5d94457ca1f453a3531c89b2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:26:01.108677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604521f8-9ff1-4d25-bf65-feb61b0ca69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.109348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604521f8-9ff1-4d25-bf65-feb61b0ca69c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.109631 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604521f8-9ff1-4d25-bf65-feb61b0ca69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.109905 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604521f8-9ff1-4d25-bf65-feb61b0ca69c admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.110707 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604521f8-9ff1-4d25-bf65-feb61b0ca69c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:01.111012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604521f8-9ff1-4d25-bf65-feb61b0ca69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.112655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604521f8-9ff1-4d25-bf65-feb61b0ca69c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.122327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 334/665] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:26:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:01.130191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204c68b-ed24-48a5-aafc-8d2f820f765a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:01.141881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204c68b-ed24-48a5-aafc-8d2f820f765a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.147940 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d12e4-ad9f-4610-bcc0-af0c80786e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.149162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d12e4-ad9f-4610-bcc0-af0c80786e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.149623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d12e4-ad9f-4610-bcc0-af0c80786e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.150081 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d12e4-ad9f-4610-bcc0-af0c80786e04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.162059 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d12e4-ad9f-4610-bcc0-af0c80786e04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.164243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d12e4-ad9f-4610-bcc0-af0c80786e04 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.183684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-3c5d12e4-ad9f-4610-bcc0-af0c80786e04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:01.185426 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 332/666] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:01.194349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604521f8-9ff1-4d25-bf65-feb61b0ca69c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:01.204279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604521f8-9ff1-4d25-bf65-feb61b0ca69c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.223423 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afc5ee-ab24-450e-93a6-0b9aa6e966a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.224299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afc5ee-ab24-450e-93a6-0b9aa6e966a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.224684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afc5ee-ab24-450e-93a6-0b9aa6e966a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.225056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afc5ee-ab24-450e-93a6-0b9aa6e966a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.225895 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afc5ee-ab24-450e-93a6-0b9aa6e966a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:01.226338 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afc5ee-ab24-450e-93a6-0b9aa6e966a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.227975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afc5ee-ab24-450e-93a6-0b9aa6e966a3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.250862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 335/667] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:01.256338 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d12e4-ad9f-4610-bcc0-af0c80786e04 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:01.270038 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d12e4-ad9f-4610-bcc0-af0c80786e04 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.283965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeafb20-8694-47d7-b485-45faf24fac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.284790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeafb20-8694-47d7-b485-45faf24fac61 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.285050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeafb20-8694-47d7-b485-45faf24fac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.285319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeafb20-8694-47d7-b485-45faf24fac61 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.298472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeafb20-8694-47d7-b485-45faf24fac61 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.300632 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeafb20-8694-47d7-b485-45faf24fac61 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.316474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-ffeafb20-8694-47d7-b485-45faf24fac61 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 01:26:01.317971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 333/668] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:26:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:01.323560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afc5ee-ab24-450e-93a6-0b9aa6e966a3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:01.335708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afc5ee-ab24-450e-93a6-0b9aa6e966a3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.351429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefccbe-bc52-4997-8986-12bfbddaa8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.352124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefccbe-bc52-4997-8986-12bfbddaa8cd admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.352407 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefccbe-bc52-4997-8986-12bfbddaa8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.352682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefccbe-bc52-4997-8986-12bfbddaa8cd admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.353528 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefccbe-bc52-4997-8986-12bfbddaa8cd admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:01.353835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefccbe-bc52-4997-8986-12bfbddaa8cd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.355724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefccbe-bc52-4997-8986-12bfbddaa8cd admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.379316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 336/669] 10.222.0.79 () {56 vars in 1160 bytes} [Mon Feb 21 01:26:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:01.384811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeafb20-8694-47d7-b485-45faf24fac61 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:01.399297 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeafb20-8694-47d7-b485-45faf24fac61 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.411533 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c74323-74f9-4e59-a079-56e407c92b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.412182 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c74323-74f9-4e59-a079-56e407c92b20 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.412459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c74323-74f9-4e59-a079-56e407c92b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.412729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c74323-74f9-4e59-a079-56e407c92b20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.422271 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c74323-74f9-4e59-a079-56e407c92b20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.424075 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c74323-74f9-4e59-a079-56e407c92b20 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.435617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 334/670] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:26:01.441268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefccbe-bc52-4997-8986-12bfbddaa8cd admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:01.451134 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefccbe-bc52-4997-8986-12bfbddaa8cd admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.463322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83642f-9fd9-486d-ae69-69b73deb867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.464123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83642f-9fd9-486d-ae69-69b73deb867c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.464403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83642f-9fd9-486d-ae69-69b73deb867c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.464678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83642f-9fd9-486d-ae69-69b73deb867c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.476166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83642f-9fd9-486d-ae69-69b73deb867c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.478023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83642f-9fd9-486d-ae69-69b73deb867c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.496492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-fc83642f-9fd9-486d-ae69-69b73deb867c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:01.498038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 337/671] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:01.503651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c74323-74f9-4e59-a079-56e407c92b20 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:01.514630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c74323-74f9-4e59-a079-56e407c92b20 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.524723 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7d346-bbc7-48ee-951f-872d09f7297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.525378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7d346-bbc7-48ee-951f-872d09f7297a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.525654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7d346-bbc7-48ee-951f-872d09f7297a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.525922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7d346-bbc7-48ee-951f-872d09f7297a admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.526671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7d346-bbc7-48ee-951f-872d09f7297a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:01.526970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7d346-bbc7-48ee-951f-872d09f7297a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.528658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7d346-bbc7-48ee-951f-872d09f7297a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.546075 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 335/672] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:01.551476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83642f-9fd9-486d-ae69-69b73deb867c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:01.561484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83642f-9fd9-486d-ae69-69b73deb867c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.570367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfbe34-5c23-4f5e-b609-aa0f3d8b405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.572413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfbe34-5c23-4f5e-b609-aa0f3d8b405e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.572413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfbe34-5c23-4f5e-b609-aa0f3d8b405e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.572413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfbe34-5c23-4f5e-b609-aa0f3d8b405e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.578837 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfbe34-5c23-4f5e-b609-aa0f3d8b405e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.580791 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfbe34-5c23-4f5e-b609-aa0f3d8b405e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.599654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-89cfbe34-5c23-4f5e-b609-aa0f3d8b405e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:01.601175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 338/673] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:01.606752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7d346-bbc7-48ee-951f-872d09f7297a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:01.623087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7d346-bbc7-48ee-951f-872d09f7297a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.629357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30747b17-006a-4b2e-a475-1c25ded57246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.630008 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30747b17-006a-4b2e-a475-1c25ded57246 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.630393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30747b17-006a-4b2e-a475-1c25ded57246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.630669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30747b17-006a-4b2e-a475-1c25ded57246 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.631517 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30747b17-006a-4b2e-a475-1c25ded57246 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:01.631823 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30747b17-006a-4b2e-a475-1c25ded57246 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.633706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30747b17-006a-4b2e-a475-1c25ded57246 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.649233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 336/674] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:01.655706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfbe34-5c23-4f5e-b609-aa0f3d8b405e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:01.666195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfbe34-5c23-4f5e-b609-aa0f3d8b405e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.674724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88cd96-58cc-4f71-903f-6c7113c87304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.675360 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88cd96-58cc-4f71-903f-6c7113c87304 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.675639 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88cd96-58cc-4f71-903f-6c7113c87304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.675913 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88cd96-58cc-4f71-903f-6c7113c87304 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.676735 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88cd96-58cc-4f71-903f-6c7113c87304 admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=3f00b174c88547e2ab799d89a50d5b6a) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:01.677043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88cd96-58cc-4f71-903f-6c7113c87304 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.678899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88cd96-58cc-4f71-903f-6c7113c87304 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.684968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 339/675] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:01 2022] GET /identity/v3/role_assignments?user.id=3f00b174c88547e2ab799d89a50d5b6a&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:03.247067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690b7d6-28dd-4cd3-8de9-95726cd98497 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.248064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690b7d6-28dd-4cd3-8de9-95726cd98497 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.249096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690b7d6-28dd-4cd3-8de9-95726cd98497 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.251593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 337/676] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:03.257441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea48e3-c4d7-4680-821f-27b794097f93 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.258348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea48e3-c4d7-4680-821f-27b794097f93 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.258830 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea48e3-c4d7-4680-821f-27b794097f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.283202 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0aea48e3-c4d7-4680-821f-27b794097f93 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:03.284723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0aea48e3-c4d7-4680-821f-27b794097f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:03.293935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 340/677] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:26:03.335676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690b7d6-28dd-4cd3-8de9-95726cd98497 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.352382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690b7d6-28dd-4cd3-8de9-95726cd98497 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:03.360423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b33b8c-7b85-4b89-a7e1-9f6296611ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:03.361953 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b33b8c-7b85-4b89-a7e1-9f6296611ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.362770 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b33b8c-7b85-4b89-a7e1-9f6296611ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.363467 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b33b8c-7b85-4b89-a7e1-9f6296611ee2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.380221 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b33b8c-7b85-4b89-a7e1-9f6296611ee2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:03.382497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b33b8c-7b85-4b89-a7e1-9f6296611ee2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:03.399838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c096cf-8542-42af-8df7-a36f2c9f4e80 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.400156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c096cf-8542-42af-8df7-a36f2c9f4e80 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.400388 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c096cf-8542-42af-8df7-a36f2c9f4e80 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.402643 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 341/678] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:03.409404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1684-35a4-4a14-a3bd-e9325099f41b None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.409709 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1684-35a4-4a14-a3bd-e9325099f41b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.409963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1684-35a4-4a14-a3bd-e9325099f41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.413160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-a2b33b8c-7b85-4b89-a7e1-9f6296611ee2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:03.414601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 338/679] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:03.420863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b33b8c-7b85-4b89-a7e1-9f6296611ee2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.428964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-76ea1684-35a4-4a14-a3bd-e9325099f41b None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:03.430815 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-76ea1684-35a4-4a14-a3bd-e9325099f41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:03.435158 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b33b8c-7b85-4b89-a7e1-9f6296611ee2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:03.445143 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 342/680] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:26:03.451824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08d85d-581f-482e-9584-e474c50b99c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:03.452618 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08d85d-581f-482e-9584-e474c50b99c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.452998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08d85d-581f-482e-9584-e474c50b99c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.453369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08d85d-581f-482e-9584-e474c50b99c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.454238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08d85d-581f-482e-9584-e474c50b99c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:03.454652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08d85d-581f-482e-9584-e474c50b99c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:03.456404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08d85d-581f-482e-9584-e474c50b99c4 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:03.469437 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 339/681] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:03.475176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1684-35a4-4a14-a3bd-e9325099f41b None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.487625 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08d85d-581f-482e-9584-e474c50b99c4 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.490038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1684-35a4-4a14-a3bd-e9325099f41b None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:03.504319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08d85d-581f-482e-9584-e474c50b99c4 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:03.506187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a76e96-2fab-400f-94c1-2bdfc928f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:03.507036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a76e96-2fab-400f-94c1-2bdfc928f04f admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.507420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a76e96-2fab-400f-94c1-2bdfc928f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.507789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a76e96-2fab-400f-94c1-2bdfc928f04f admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.508713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a76e96-2fab-400f-94c1-2bdfc928f04f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:03.510915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a76e96-2fab-400f-94c1-2bdfc928f04f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:03.522970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6c819-b550-4b4b-aae3-81d8682c1846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:03.523920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6c819-b550-4b4b-aae3-81d8682c1846 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.524298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6c819-b550-4b4b-aae3-81d8682c1846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.524685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6c819-b550-4b4b-aae3-81d8682c1846 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.538902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6c819-b550-4b4b-aae3-81d8682c1846 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:03.553200 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 343/682] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:26:03 2022] POST /identity/v3/users => generated 254 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:03.553379 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-90f6c819-b550-4b4b-aae3-81d8682c1846 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:26:03.555120 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 340/683] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:03.561523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a76e96-2fab-400f-94c1-2bdfc928f04f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.575780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a76e96-2fab-400f-94c1-2bdfc928f04f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:03.585793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81496db4-cf07-48e2-8f36-f2bb186ba669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:03.586668 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81496db4-cf07-48e2-8f36-f2bb186ba669 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.587186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81496db4-cf07-48e2-8f36-f2bb186ba669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.587558 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81496db4-cf07-48e2-8f36-f2bb186ba669 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.588476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81496db4-cf07-48e2-8f36-f2bb186ba669 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:03.588882 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81496db4-cf07-48e2-8f36-f2bb186ba669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:03.590682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81496db4-cf07-48e2-8f36-f2bb186ba669 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:03.609684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 344/684] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:26:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:03.614941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6c819-b550-4b4b-aae3-81d8682c1846 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.629884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6c819-b550-4b4b-aae3-81d8682c1846 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:03.643570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8308-f726-48c1-9499-5c07353e5d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:03.644555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8308-f726-48c1-9499-5c07353e5d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.644937 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8308-f726-48c1-9499-5c07353e5d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.645307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8308-f726-48c1-9499-5c07353e5d84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.663134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d8308-f726-48c1-9499-5c07353e5d84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:03.665226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d8308-f726-48c1-9499-5c07353e5d84 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:03.688895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-af4d8308-f726-48c1-9499-5c07353e5d84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:03.695906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81496db4-cf07-48e2-8f36-f2bb186ba669 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.696572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 341/685] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:03.716776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81496db4-cf07-48e2-8f36-f2bb186ba669 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:03.732057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd18d2-9d20-486d-8987-a03a40cf5244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:03.733331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd18d2-9d20-486d-8987-a03a40cf5244 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.733617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd18d2-9d20-486d-8987-a03a40cf5244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.733893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd18d2-9d20-486d-8987-a03a40cf5244 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.734678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd18d2-9d20-486d-8987-a03a40cf5244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:03.734987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd18d2-9d20-486d-8987-a03a40cf5244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:03.736816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd18d2-9d20-486d-8987-a03a40cf5244 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:03.758243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 345/686] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:03.763775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8308-f726-48c1-9499-5c07353e5d84 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.774007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8308-f726-48c1-9499-5c07353e5d84 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:03.786032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd993776-ccb7-46c1-916e-1ea477f2c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:03.786996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd993776-ccb7-46c1-916e-1ea477f2c02e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.787372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd993776-ccb7-46c1-916e-1ea477f2c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.787780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd993776-ccb7-46c1-916e-1ea477f2c02e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.796587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd993776-ccb7-46c1-916e-1ea477f2c02e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:03.798801 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd993776-ccb7-46c1-916e-1ea477f2c02e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:03.812886 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-dd993776-ccb7-46c1-916e-1ea477f2c02e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:26:03.814525 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 342/687] 10.222.0.79 () {56 vars in 1114 bytes} [Mon Feb 21 01:26:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:03.820230 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd18d2-9d20-486d-8987-a03a40cf5244 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.831850 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd18d2-9d20-486d-8987-a03a40cf5244 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:03.836624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec881b2-ddf3-4a88-af1c-934cd549bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:03.837447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec881b2-ddf3-4a88-af1c-934cd549bac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.837871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec881b2-ddf3-4a88-af1c-934cd549bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.838342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec881b2-ddf3-4a88-af1c-934cd549bac9 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.839323 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec881b2-ddf3-4a88-af1c-934cd549bac9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:03.839822 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec881b2-ddf3-4a88-af1c-934cd549bac9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:03.841802 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec881b2-ddf3-4a88-af1c-934cd549bac9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:03.861356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 346/688] 10.222.0.79 () {56 vars in 1154 bytes} [Mon Feb 21 01:26:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:03.866606 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd993776-ccb7-46c1-916e-1ea477f2c02e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.877056 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd993776-ccb7-46c1-916e-1ea477f2c02e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:03.881898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915c52b-123b-4088-9d62-5aa2cf237193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:03.882750 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c52b-123b-4088-9d62-5aa2cf237193 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.883175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c52b-123b-4088-9d62-5aa2cf237193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.883618 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c52b-123b-4088-9d62-5aa2cf237193 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.892159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915c52b-123b-4088-9d62-5aa2cf237193 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:03.894153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915c52b-123b-4088-9d62-5aa2cf237193 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:03.897250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4ee12-573d-4637-b7ef-53e5cd11d650 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.897690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4ee12-573d-4637-b7ef-53e5cd11d650 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.898111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4ee12-573d-4637-b7ef-53e5cd11d650 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.900321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 347/689] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:03.905665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba0710-de1e-413a-adf9-666d7c11013e None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.906176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba0710-de1e-413a-adf9-666d7c11013e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.906616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba0710-de1e-413a-adf9-666d7c11013e None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.907749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 343/690] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:26:03.908800 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 348/691] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:03.909073 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2fa3-5dcf-41d2-95b7-9dbb0aa7a9ce None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.909366 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2fa3-5dcf-41d2-95b7-9dbb0aa7a9ce None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.909640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2fa3-5dcf-41d2-95b7-9dbb0aa7a9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.914744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba0710-de1e-413a-adf9-666d7c11013e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.928260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba0710-de1e-413a-adf9-666d7c11013e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:03.934856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-ae0f2fa3-5dcf-41d2-95b7-9dbb0aa7a9ce None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:03.935158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f0468-5ebd-487c-b3a2-a9a1e93fdea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:03.936076 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ae0f2fa3-5dcf-41d2-95b7-9dbb0aa7a9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:03.936309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f0468-5ebd-487c-b3a2-a9a1e93fdea7 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.936729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f0468-5ebd-487c-b3a2-a9a1e93fdea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.937159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f0468-5ebd-487c-b3a2-a9a1e93fdea7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.944446 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 344/692] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:26:03.948018 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7d298-77d8-4804-8f84-e37566209c59 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.948407 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7d298-77d8-4804-8f84-e37566209c59 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.948810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7d298-77d8-4804-8f84-e37566209c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.952450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f0468-5ebd-487c-b3a2-a9a1e93fdea7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:03.954682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f0468-5ebd-487c-b3a2-a9a1e93fdea7 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:03.969572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-67d7d298-77d8-4804-8f84-e37566209c59 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:03.970902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-67d7d298-77d8-4804-8f84-e37566209c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:03.974463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-3c0f0468-5ebd-487c-b3a2-a9a1e93fdea7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:03.976183 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 349/693] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:03.977250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f0468-5ebd-487c-b3a2-a9a1e93fdea7 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.978767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 345/694] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:26:03.986448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7d298-77d8-4804-8f84-e37566209c59 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:03.988043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f0468-5ebd-487c-b3a2-a9a1e93fdea7 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:03.992790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d82a-77e7-40d5-885e-ae5158f5c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:03.993725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d82a-77e7-40d5-885e-ae5158f5c37b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.994151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d82a-77e7-40d5-885e-ae5158f5c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.994590 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d82a-77e7-40d5-885e-ae5158f5c37b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.996389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7d298-77d8-4804-8f84-e37566209c59 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.001822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca27d6-a17e-4b54-ac55-8b1834f17c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.002585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca27d6-a17e-4b54-ac55-8b1834f17c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.002936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca27d6-a17e-4b54-ac55-8b1834f17c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.003443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca27d6-a17e-4b54-ac55-8b1834f17c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.004533 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca27d6-a17e-4b54-ac55-8b1834f17c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.004915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca27d6-a17e-4b54-ac55-8b1834f17c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.006606 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca27d6-a17e-4b54-ac55-8b1834f17c69 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.007896 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2d82a-77e7-40d5-885e-ae5158f5c37b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:04.015584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-4de2d82a-77e7-40d5-885e-ae5158f5c37b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:26:04.016930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 350/695] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:26:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:04.017842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d82a-77e7-40d5-885e-ae5158f5c37b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.019956 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 346/696] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:04.023535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca27d6-a17e-4b54-ac55-8b1834f17c69 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.033940 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca27d6-a17e-4b54-ac55-8b1834f17c69 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.035695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d82a-77e7-40d5-885e-ae5158f5c37b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.039190 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019ec00-6da4-4855-ab0f-970805fc4a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.040022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019ec00-6da4-4855-ab0f-970805fc4a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.040537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019ec00-6da4-4855-ab0f-970805fc4a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.040847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198018-945f-427c-9e82-1edddc12fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.041126 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019ec00-6da4-4855-ab0f-970805fc4a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.041744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198018-945f-427c-9e82-1edddc12fab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.042064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198018-945f-427c-9e82-1edddc12fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.042373 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198018-945f-427c-9e82-1edddc12fab2 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.042515 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019ec00-6da4-4855-ab0f-970805fc4a65 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.042952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019ec00-6da4-4855-ab0f-970805fc4a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.043122 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198018-945f-427c-9e82-1edddc12fab2 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.044252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-d9198018-945f-427c-9e82-1edddc12fab2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:26:04.044252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:26:04.044252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:26:04.045111 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019ec00-6da4-4855-ab0f-970805fc4a65 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.045250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198018-945f-427c-9e82-1edddc12fab2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.054572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 347/697] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:04.055647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019ec00-6da4-4855-ab0f-970805fc4a65 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.065622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019ec00-6da4-4855-ab0f-970805fc4a65 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.066330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-d9198018-945f-427c-9e82-1edddc12fab2 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 01:26:04.067663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 351/698] 10.222.0.79 () {56 vars in 1150 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:04.071007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198018-945f-427c-9e82-1edddc12fab2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.080371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caced8fd-8da6-4b7b-81d4-7ce09e802236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.081223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caced8fd-8da6-4b7b-81d4-7ce09e802236 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.081510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caced8fd-8da6-4b7b-81d4-7ce09e802236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.081840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caced8fd-8da6-4b7b-81d4-7ce09e802236 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.084159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198018-945f-427c-9e82-1edddc12fab2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.090934 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caced8fd-8da6-4b7b-81d4-7ce09e802236 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.092968 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caced8fd-8da6-4b7b-81d4-7ce09e802236 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.100358 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33ac8f-5ed1-4a1b-bdd5-9b803a396d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.101354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33ac8f-5ed1-4a1b-bdd5-9b803a396d20 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.101780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33ac8f-5ed1-4a1b-bdd5-9b803a396d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.102196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33ac8f-5ed1-4a1b-bdd5-9b803a396d20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.107187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-caced8fd-8da6-4b7b-81d4-7ce09e802236 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:04.108785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 348/699] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:04.109670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caced8fd-8da6-4b7b-81d4-7ce09e802236 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.117481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33ac8f-5ed1-4a1b-bdd5-9b803a396d20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.118387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33ac8f-5ed1-4a1b-bdd5-9b803a396d20 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.122669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caced8fd-8da6-4b7b-81d4-7ce09e802236 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.127751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cf99d-942d-4775-ad2c-497fa72ba8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.128624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cf99d-942d-4775-ad2c-497fa72ba8cc admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.128887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cf99d-942d-4775-ad2c-497fa72ba8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.129155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cf99d-942d-4775-ad2c-497fa72ba8cc admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.129859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cf99d-942d-4775-ad2c-497fa72ba8cc admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.130144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cf99d-942d-4775-ad2c-497fa72ba8cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.131170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-4b1cf99d-942d-4775-ad2c-497fa72ba8cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:26:04.131170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:26:04.131170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:26:04.132046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cf99d-942d-4775-ad2c-497fa72ba8cc admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.141523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 349/700] 10.222.0.79 () {56 vars in 1145 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:04.141523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cf99d-942d-4775-ad2c-497fa72ba8cc admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.146195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-ea33ac8f-5ed1-4a1b-bdd5-9b803a396d20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:04.146823 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cf99d-942d-4775-ad2c-497fa72ba8cc admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.148445 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 352/701] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:04.149726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33ac8f-5ed1-4a1b-bdd5-9b803a396d20 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.151530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c9681-d7b4-4c54-88a5-96440f71bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.152280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c9681-d7b4-4c54-88a5-96440f71bc4a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.152593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c9681-d7b4-4c54-88a5-96440f71bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.152870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c9681-d7b4-4c54-88a5-96440f71bc4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.153642 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c9681-d7b4-4c54-88a5-96440f71bc4a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.153945 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c9681-d7b4-4c54-88a5-96440f71bc4a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.156365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c9681-d7b4-4c54-88a5-96440f71bc4a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.163662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33ac8f-5ed1-4a1b-bdd5-9b803a396d20 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.174416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 350/702] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:04.174416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c9681-d7b4-4c54-88a5-96440f71bc4a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.175712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777a87d-dbe7-4d44-b119-522c0f7893b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.177224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a87d-dbe7-4d44-b119-522c0f7893b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.177657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a87d-dbe7-4d44-b119-522c0f7893b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.178398 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a87d-dbe7-4d44-b119-522c0f7893b2 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.179390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777a87d-dbe7-4d44-b119-522c0f7893b2 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.179864 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777a87d-dbe7-4d44-b119-522c0f7893b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.180089 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c9681-d7b4-4c54-88a5-96440f71bc4a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.181343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-b777a87d-dbe7-4d44-b119-522c0f7893b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:26:04.181343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:26:04.181343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:26:04.182798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777a87d-dbe7-4d44-b119-522c0f7893b2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.184929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dd805-ab0f-4afa-b6e4-3bc13f05f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.185551 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dd805-ab0f-4afa-b6e4-3bc13f05f54e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.186495 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dd805-ab0f-4afa-b6e4-3bc13f05f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.186836 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dd805-ab0f-4afa-b6e4-3bc13f05f54e admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.187621 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dd805-ab0f-4afa-b6e4-3bc13f05f54e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.187987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dd805-ab0f-4afa-b6e4-3bc13f05f54e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.189645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dd805-ab0f-4afa-b6e4-3bc13f05f54e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.199004 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 353/703] 10.222.0.79 () {56 vars in 1145 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:04.200015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777a87d-dbe7-4d44-b119-522c0f7893b2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.210892 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 351/704] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:04.216562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dd805-ab0f-4afa-b6e4-3bc13f05f54e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.221794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777a87d-dbe7-4d44-b119-522c0f7893b2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.228871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dd805-ab0f-4afa-b6e4-3bc13f05f54e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.234738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24425db-0d4a-4e53-abbb-48ca619be93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.235414 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24425db-0d4a-4e53-abbb-48ca619be93d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.235689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24425db-0d4a-4e53-abbb-48ca619be93d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.235960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24425db-0d4a-4e53-abbb-48ca619be93d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.236804 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24425db-0d4a-4e53-abbb-48ca619be93d admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=333ec5b3842b432a99bc265abbe7fa58) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.237111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24425db-0d4a-4e53-abbb-48ca619be93d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.239019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24425db-0d4a-4e53-abbb-48ca619be93d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.246507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 354/705] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/role_assignments?user.id=333ec5b3842b432a99bc265abbe7fa58&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=548abad662724741a3261205ee7cb828 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:04.246944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4809d-0f33-486a-ad28-3090c8be773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.247736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4809d-0f33-486a-ad28-3090c8be773a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.248343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4809d-0f33-486a-ad28-3090c8be773a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.248343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4809d-0f33-486a-ad28-3090c8be773a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.257970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4809d-0f33-486a-ad28-3090c8be773a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.260105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4809d-0f33-486a-ad28-3090c8be773a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.274589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-b8b4809d-0f33-486a-ad28-3090c8be773a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 01:26:04.276181 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 352/706] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:04.283326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24425db-0d4a-4e53-abbb-48ca619be93d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.300405 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24425db-0d4a-4e53-abbb-48ca619be93d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.309111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662666da-d110-4037-8467-25b8f6bfdb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.309910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662666da-d110-4037-8467-25b8f6bfdb49 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.310318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662666da-d110-4037-8467-25b8f6bfdb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.310666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662666da-d110-4037-8467-25b8f6bfdb49 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.312151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662666da-d110-4037-8467-25b8f6bfdb49 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.312530 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662666da-d110-4037-8467-25b8f6bfdb49 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.314477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662666da-d110-4037-8467-25b8f6bfdb49 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.341895 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 355/707] 10.222.0.79 () {56 vars in 1156 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:04.348162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4809d-0f33-486a-ad28-3090c8be773a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.359080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4809d-0f33-486a-ad28-3090c8be773a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.369268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d5b5d-018b-4239-a725-00a96a32ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.369860 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d5b5d-018b-4239-a725-00a96a32ea91 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.370141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d5b5d-018b-4239-a725-00a96a32ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.370441 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d5b5d-018b-4239-a725-00a96a32ea91 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.380404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d5b5d-018b-4239-a725-00a96a32ea91 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.382282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d5b5d-018b-4239-a725-00a96a32ea91 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.392958 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 353/708] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:26:04.398776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662666da-d110-4037-8467-25b8f6bfdb49 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.411693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662666da-d110-4037-8467-25b8f6bfdb49 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.423281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954b409-0ec0-4bc0-af1d-4d0facd7bff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.424191 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954b409-0ec0-4bc0-af1d-4d0facd7bff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.424541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954b409-0ec0-4bc0-af1d-4d0facd7bff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.424881 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954b409-0ec0-4bc0-af1d-4d0facd7bff0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.446703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954b409-0ec0-4bc0-af1d-4d0facd7bff0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.448675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954b409-0ec0-4bc0-af1d-4d0facd7bff0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.475470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-3954b409-0ec0-4bc0-af1d-4d0facd7bff0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:04.476807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 356/709] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:04.483474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d5b5d-018b-4239-a725-00a96a32ea91 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.500039 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d5b5d-018b-4239-a725-00a96a32ea91 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.509281 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4ab77-2186-4b96-9bab-1a81f34de305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.509974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4ab77-2186-4b96-9bab-1a81f34de305 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.510280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4ab77-2186-4b96-9bab-1a81f34de305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.510559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4ab77-2186-4b96-9bab-1a81f34de305 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.511304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4ab77-2186-4b96-9bab-1a81f34de305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.511611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4ab77-2186-4b96-9bab-1a81f34de305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.513236 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4ab77-2186-4b96-9bab-1a81f34de305 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.528471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 354/710] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:04.534252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954b409-0ec0-4bc0-af1d-4d0facd7bff0 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.544642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954b409-0ec0-4bc0-af1d-4d0facd7bff0 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.549800 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bbac7-c303-4a84-8aa1-2945ee810e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.550717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bbac7-c303-4a84-8aa1-2945ee810e20 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.550998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bbac7-c303-4a84-8aa1-2945ee810e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.551272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bbac7-c303-4a84-8aa1-2945ee810e20 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.559504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bbac7-c303-4a84-8aa1-2945ee810e20 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.561630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bbac7-c303-4a84-8aa1-2945ee810e20 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.575807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-249bbac7-c303-4a84-8aa1-2945ee810e20 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:04.577859 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 357/711] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:04.583670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4ab77-2186-4b96-9bab-1a81f34de305 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.594752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4ab77-2186-4b96-9bab-1a81f34de305 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.599743 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0cada-499a-4bcd-98cf-b38150958733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.600460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0cada-499a-4bcd-98cf-b38150958733 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.600739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0cada-499a-4bcd-98cf-b38150958733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.601011 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0cada-499a-4bcd-98cf-b38150958733 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.601895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0cada-499a-4bcd-98cf-b38150958733 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.602271 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0cada-499a-4bcd-98cf-b38150958733 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.604177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0cada-499a-4bcd-98cf-b38150958733 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.617486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 355/712] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:04.623453 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bbac7-c303-4a84-8aa1-2945ee810e20 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.634548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bbac7-c303-4a84-8aa1-2945ee810e20 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.639448 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abb240-2380-4c72-a810-76662b73a800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.640158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abb240-2380-4c72-a810-76662b73a800 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.640438 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abb240-2380-4c72-a810-76662b73a800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.640717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abb240-2380-4c72-a810-76662b73a800 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.641596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abb240-2380-4c72-a810-76662b73a800 admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=0cb0a0d56f0049b19ba22e0dd041897e) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.641897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abb240-2380-4c72-a810-76662b73a800 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.643875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abb240-2380-4c72-a810-76662b73a800 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.650725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 358/713] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/role_assignments?user.id=0cb0a0d56f0049b19ba22e0dd041897e&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:04.807952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577f911-24d5-4532-bdac-70e1a43db7db None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.808235 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577f911-24d5-4532-bdac-70e1a43db7db None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.808509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577f911-24d5-4532-bdac-70e1a43db7db None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.810564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 356/714] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:04.816110 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a57e74-029e-4a69-a51e-26128637a446 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.816397 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a57e74-029e-4a69-a51e-26128637a446 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.816678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a57e74-029e-4a69-a51e-26128637a446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.840323 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-d3a57e74-029e-4a69-a51e-26128637a446 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:04.841592 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d3a57e74-029e-4a69-a51e-26128637a446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:04.852565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 359/715] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:26:04.890518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577f911-24d5-4532-bdac-70e1a43db7db None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.906762 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577f911-24d5-4532-bdac-70e1a43db7db None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.911250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1d54-297d-4e0b-afb4-2fa5e35dd149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.912198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1d54-297d-4e0b-afb4-2fa5e35dd149 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.912629 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1d54-297d-4e0b-afb4-2fa5e35dd149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.913049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1d54-297d-4e0b-afb4-2fa5e35dd149 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.913872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f1d54-297d-4e0b-afb4-2fa5e35dd149 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.915059 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-d56f1d54-297d-4e0b-afb4-2fa5e35dd149 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:26:04.915059 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:26:04.915059 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:26:04.916207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f1d54-297d-4e0b-afb4-2fa5e35dd149 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.929499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-d56f1d54-297d-4e0b-afb4-2fa5e35dd149 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 01:26:04.934486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 357/716] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:04.940382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a57e74-029e-4a69-a51e-26128637a446 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.949500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a57e74-029e-4a69-a51e-26128637a446 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.956694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e75fea-9894-4474-9fd9-7d25aef3a238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.957429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e75fea-9894-4474-9fd9-7d25aef3a238 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.957767 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e75fea-9894-4474-9fd9-7d25aef3a238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.958047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e75fea-9894-4474-9fd9-7d25aef3a238 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.958848 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e75fea-9894-4474-9fd9-7d25aef3a238 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.959161 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e75fea-9894-4474-9fd9-7d25aef3a238 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.960758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e75fea-9894-4474-9fd9-7d25aef3a238 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.966855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 360/717] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:04.973037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1d54-297d-4e0b-afb4-2fa5e35dd149 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.988163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1d54-297d-4e0b-afb4-2fa5e35dd149 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.992834 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6254f42-270d-4140-a1f4-1468e83a46e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.993644 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6254f42-270d-4140-a1f4-1468e83a46e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.994096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6254f42-270d-4140-a1f4-1468e83a46e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.994593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6254f42-270d-4140-a1f4-1468e83a46e8 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.995442 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6254f42-270d-4140-a1f4-1468e83a46e8 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:04.995896 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6254f42-270d-4140-a1f4-1468e83a46e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.997631 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6254f42-270d-4140-a1f4-1468e83a46e8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:05.004822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 358/718] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:06.610382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab11a0-002b-4c90-859e-77074dff6bd3 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:06.610915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab11a0-002b-4c90-859e-77074dff6bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:06.611207 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab11a0-002b-4c90-859e-77074dff6bd3 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:06.613324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 361/719] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:06.618729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764877f-0097-4b89-99b5-2785ccb2cf0a None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:06.619133 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764877f-0097-4b89-99b5-2785ccb2cf0a None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:06.619306 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764877f-0097-4b89-99b5-2785ccb2cf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:06.647179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-d764877f-0097-4b89-99b5-2785ccb2cf0a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:06.648390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-d764877f-0097-4b89-99b5-2785ccb2cf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:06.656607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 359/720] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:26:06.703726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab11a0-002b-4c90-859e-77074dff6bd3 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:06.720006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab11a0-002b-4c90-859e-77074dff6bd3 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:06.724573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a8289-9613-4e16-adb1-da739fc8e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:06.725385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a8289-9613-4e16-adb1-da739fc8e89f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:06.725661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a8289-9613-4e16-adb1-da739fc8e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:06.725927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a8289-9613-4e16-adb1-da739fc8e89f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:06.741560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a8289-9613-4e16-adb1-da739fc8e89f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:06.748494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-3e2a8289-9613-4e16-adb1-da739fc8e89f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:26:06.749951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 362/721] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:26:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:06.756339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764877f-0097-4b89-99b5-2785ccb2cf0a None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:06.765738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764877f-0097-4b89-99b5-2785ccb2cf0a None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:06.774634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2715e09-ab47-4405-ba43-02fe978bcc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:06.775325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2715e09-ab47-4405-ba43-02fe978bcc08 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:06.775603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2715e09-ab47-4405-ba43-02fe978bcc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:06.775872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2715e09-ab47-4405-ba43-02fe978bcc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:06.776641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2715e09-ab47-4405-ba43-02fe978bcc08 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:06.776940 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2715e09-ab47-4405-ba43-02fe978bcc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:06.778621 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2715e09-ab47-4405-ba43-02fe978bcc08 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:06.794006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 360/722] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:26:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:06.800499 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a8289-9613-4e16-adb1-da739fc8e89f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:06.815098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a8289-9613-4e16-adb1-da739fc8e89f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:06.823331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55216a4-22c9-4451-bbfe-01c8bdd9ed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:06.824123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55216a4-22c9-4451-bbfe-01c8bdd9ed9d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:06.824405 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55216a4-22c9-4451-bbfe-01c8bdd9ed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:06.824676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55216a4-22c9-4451-bbfe-01c8bdd9ed9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:06.837360 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55216a4-22c9-4451-bbfe-01c8bdd9ed9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:06.839233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55216a4-22c9-4451-bbfe-01c8bdd9ed9d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:06.859154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-f55216a4-22c9-4451-bbfe-01c8bdd9ed9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:06.860345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 363/723] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:06.866193 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2715e09-ab47-4405-ba43-02fe978bcc08 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:06.879299 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2715e09-ab47-4405-ba43-02fe978bcc08 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:06.886817 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e82d3-5423-4df8-937f-b7fe449d88b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:06.887479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e82d3-5423-4df8-937f-b7fe449d88b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:06.887759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e82d3-5423-4df8-937f-b7fe449d88b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:06.888034 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e82d3-5423-4df8-937f-b7fe449d88b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:06.888760 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e82d3-5423-4df8-937f-b7fe449d88b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:06.889096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e82d3-5423-4df8-937f-b7fe449d88b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:06.890718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e82d3-5423-4df8-937f-b7fe449d88b4 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:06.903061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 361/724] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:06.909063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55216a4-22c9-4451-bbfe-01c8bdd9ed9d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:06.918998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55216a4-22c9-4451-bbfe-01c8bdd9ed9d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:06.926290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fb59c-169a-4fa5-900d-45c43e1fdcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:06.927087 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fb59c-169a-4fa5-900d-45c43e1fdcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:06.927367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fb59c-169a-4fa5-900d-45c43e1fdcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:06.927632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fb59c-169a-4fa5-900d-45c43e1fdcd3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:06.939328 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fb59c-169a-4fa5-900d-45c43e1fdcd3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:06.941332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fb59c-169a-4fa5-900d-45c43e1fdcd3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:06.958114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-f29fb59c-169a-4fa5-900d-45c43e1fdcd3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 01:26:06.959577 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 364/725] 10.222.0.79 () {56 vars in 1138 bytes} [Mon Feb 21 01:26:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:06.965462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e82d3-5423-4df8-937f-b7fe449d88b4 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:06.979115 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e82d3-5423-4df8-937f-b7fe449d88b4 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:06.987348 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2ed25-9886-4684-a3a5-fcd0ac953d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:06.988015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2ed25-9886-4684-a3a5-fcd0ac953d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:06.988297 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2ed25-9886-4684-a3a5-fcd0ac953d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:06.988569 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2ed25-9886-4684-a3a5-fcd0ac953d4b admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:06.989410 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2ed25-9886-4684-a3a5-fcd0ac953d4b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:06.989715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2ed25-9886-4684-a3a5-fcd0ac953d4b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:06.991592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2ed25-9886-4684-a3a5-fcd0ac953d4b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.020662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 362/726] 10.222.0.79 () {56 vars in 1170 bytes} [Mon Feb 21 01:26:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:07.026446 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fb59c-169a-4fa5-900d-45c43e1fdcd3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.039126 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fb59c-169a-4fa5-900d-45c43e1fdcd3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.046818 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f5016-2fa1-4e7b-b4b0-14879b853fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.047475 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f5016-2fa1-4e7b-b4b0-14879b853fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.047763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f5016-2fa1-4e7b-b4b0-14879b853fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.048028 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f5016-2fa1-4e7b-b4b0-14879b853fe6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.056275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f5016-2fa1-4e7b-b4b0-14879b853fe6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.058012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f5016-2fa1-4e7b-b4b0-14879b853fe6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.070330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 365/727] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:26:07.076175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2ed25-9886-4684-a3a5-fcd0ac953d4b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.093737 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2ed25-9886-4684-a3a5-fcd0ac953d4b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.107789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e3759-1587-475d-b956-367ec1e63452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.108590 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e3759-1587-475d-b956-367ec1e63452 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.108872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e3759-1587-475d-b956-367ec1e63452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.109144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e3759-1587-475d-b956-367ec1e63452 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.124959 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e3759-1587-475d-b956-367ec1e63452 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.126748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e3759-1587-475d-b956-367ec1e63452 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.159741 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5166bb8-4760-4881-a724-859246380094 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.160043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-c65e3759-1587-475d-b956-367ec1e63452 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:07.160202 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5166bb8-4760-4881-a724-859246380094 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.160351 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5166bb8-4760-4881-a724-859246380094 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.161227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 363/728] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:07.162541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 366/729] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:07.166559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e3759-1587-475d-b956-367ec1e63452 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.176853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e3759-1587-475d-b956-367ec1e63452 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.182076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765c13c-2b5a-487d-a899-eb4012e3e4f0 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.182411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765c13c-2b5a-487d-a899-eb4012e3e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.182686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765c13c-2b5a-487d-a899-eb4012e3e4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.184018 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9809d-ab35-4eb8-a9b9-570e7ca64b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.184662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9809d-ab35-4eb8-a9b9-570e7ca64b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.184944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9809d-ab35-4eb8-a9b9-570e7ca64b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.185222 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9809d-ab35-4eb8-a9b9-570e7ca64b71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.185998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9809d-ab35-4eb8-a9b9-570e7ca64b71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:07.186343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9809d-ab35-4eb8-a9b9-570e7ca64b71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.188039 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9809d-ab35-4eb8-a9b9-570e7ca64b71 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.210135 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 364/730] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:07.215313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9809d-ab35-4eb8-a9b9-570e7ca64b71 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.220158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-d765c13c-2b5a-487d-a899-eb4012e3e4f0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:07.221345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d765c13c-2b5a-487d-a899-eb4012e3e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:07.227592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9809d-ab35-4eb8-a9b9-570e7ca64b71 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.235611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cee4d4-b577-4172-8a83-792d02a1ab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.236390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cee4d4-b577-4172-8a83-792d02a1ab3d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.236671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cee4d4-b577-4172-8a83-792d02a1ab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.236945 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cee4d4-b577-4172-8a83-792d02a1ab3d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.240928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 367/731] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:26:07.246191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cee4d4-b577-4172-8a83-792d02a1ab3d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.248284 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cee4d4-b577-4172-8a83-792d02a1ab3d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.262169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765c13c-2b5a-487d-a899-eb4012e3e4f0 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.268591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-b1cee4d4-b577-4172-8a83-792d02a1ab3d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:07.270038 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 365/732] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:07.275331 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cee4d4-b577-4172-8a83-792d02a1ab3d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.281181 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765c13c-2b5a-487d-a899-eb4012e3e4f0 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.285813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cee4d4-b577-4172-8a83-792d02a1ab3d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.290539 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37343112-966e-4af7-815a-248ba741e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.291269 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37343112-966e-4af7-815a-248ba741e5ed admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.291610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37343112-966e-4af7-815a-248ba741e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.291821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37343112-966e-4af7-815a-248ba741e5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.292690 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37343112-966e-4af7-815a-248ba741e5ed admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:07.293003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37343112-966e-4af7-815a-248ba741e5ed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.294904 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37343112-966e-4af7-815a-248ba741e5ed admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.298910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35659285-fffb-4be2-994d-c1037ce92f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.299588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35659285-fffb-4be2-994d-c1037ce92f6a admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.299871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35659285-fffb-4be2-994d-c1037ce92f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.300143 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35659285-fffb-4be2-994d-c1037ce92f6a admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.300889 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35659285-fffb-4be2-994d-c1037ce92f6a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.301903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-35659285-fffb-4be2-994d-c1037ce92f6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:26:07.301903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:26:07.301903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:26:07.302825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35659285-fffb-4be2-994d-c1037ce92f6a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.307204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 366/733] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:07.312882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37343112-966e-4af7-815a-248ba741e5ed admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.323599 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37343112-966e-4af7-815a-248ba741e5ed admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.328886 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5171638-d80c-4681-be5b-ded980902542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.329546 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5171638-d80c-4681-be5b-ded980902542 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.329828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5171638-d80c-4681-be5b-ded980902542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.330100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5171638-d80c-4681-be5b-ded980902542 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.330977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5171638-d80c-4681-be5b-ded980902542 admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=19893604215b4bd397178347775e0bb2) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:07.331283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5171638-d80c-4681-be5b-ded980902542 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.333177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5171638-d80c-4681-be5b-ded980902542 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.339390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 368/734] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:26:07 2022] POST /identity/v3/services => generated 251 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:26:07.342636 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568f55-48a4-4453-8fee-8666eb41baf1 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.342908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568f55-48a4-4453-8fee-8666eb41baf1 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.343186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568f55-48a4-4453-8fee-8666eb41baf1 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.346519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 369/735] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:07.350703 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 367/736] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/role_assignments?user.id=19893604215b4bd397178347775e0bb2&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:07.361595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa382c5-0b97-411d-82a2-dc61b7dca86c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.361909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa382c5-0b97-411d-82a2-dc61b7dca86c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.362149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa382c5-0b97-411d-82a2-dc61b7dca86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.394941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-5fa382c5-0b97-411d-82a2-dc61b7dca86c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:07.396109 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5fa382c5-0b97-411d-82a2-dc61b7dca86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:07.434858 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 370/737] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:07 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:07.479159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5171638-d80c-4681-be5b-ded980902542 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.490390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5171638-d80c-4681-be5b-ded980902542 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.508538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003459e-0d35-40d6-8000-649885d82b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.509422 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003459e-0d35-40d6-8000-649885d82b16 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.509712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003459e-0d35-40d6-8000-649885d82b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.510038 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003459e-0d35-40d6-8000-649885d82b16 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.526344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003459e-0d35-40d6-8000-649885d82b16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:07.533720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-f003459e-0d35-40d6-8000-649885d82b16 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:26:07.535367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 368/738] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:07.545575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa382c5-0b97-411d-82a2-dc61b7dca86c None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.554240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa382c5-0b97-411d-82a2-dc61b7dca86c None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.567169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29d7af-38df-47de-8da0-31b430f8c974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.568193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29d7af-38df-47de-8da0-31b430f8c974 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.568632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29d7af-38df-47de-8da0-31b430f8c974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.569059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29d7af-38df-47de-8da0-31b430f8c974 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.570009 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29d7af-38df-47de-8da0-31b430f8c974 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:07.570625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29d7af-38df-47de-8da0-31b430f8c974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.572489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29d7af-38df-47de-8da0-31b430f8c974 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.585927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 371/739] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:07.591517 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003459e-0d35-40d6-8000-649885d82b16 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.607968 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003459e-0d35-40d6-8000-649885d82b16 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.614612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb94077-2422-49f4-9a09-ffb3b4ebbd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.615416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb94077-2422-49f4-9a09-ffb3b4ebbd69 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.615704 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb94077-2422-49f4-9a09-ffb3b4ebbd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.616014 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb94077-2422-49f4-9a09-ffb3b4ebbd69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.632466 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb94077-2422-49f4-9a09-ffb3b4ebbd69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.634363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb94077-2422-49f4-9a09-ffb3b4ebbd69 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.657116 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-4cb94077-2422-49f4-9a09-ffb3b4ebbd69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:07.658600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 369/740] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:07.663968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29d7af-38df-47de-8da0-31b430f8c974 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.676051 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29d7af-38df-47de-8da0-31b430f8c974 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.682725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd35496-e453-44da-901d-999e28f00840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.683402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd35496-e453-44da-901d-999e28f00840 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.683692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd35496-e453-44da-901d-999e28f00840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.683959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd35496-e453-44da-901d-999e28f00840 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.684695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd35496-e453-44da-901d-999e28f00840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:07.685001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd35496-e453-44da-901d-999e28f00840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.687163 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd35496-e453-44da-901d-999e28f00840 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.703248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 372/741] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:07.708857 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb94077-2422-49f4-9a09-ffb3b4ebbd69 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.723249 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb94077-2422-49f4-9a09-ffb3b4ebbd69 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.733270 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b74ad-65a0-4a7a-8d2b-6318c09346db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.734124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b74ad-65a0-4a7a-8d2b-6318c09346db admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.734460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b74ad-65a0-4a7a-8d2b-6318c09346db admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.734787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b74ad-65a0-4a7a-8d2b-6318c09346db admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.744000 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b74ad-65a0-4a7a-8d2b-6318c09346db admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.746034 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b74ad-65a0-4a7a-8d2b-6318c09346db admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.765167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-111b74ad-65a0-4a7a-8d2b-6318c09346db admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:26:07.766683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 370/742] 10.222.0.79 () {56 vars in 1114 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:07.771850 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e1fc9-0c19-4e6e-8ab9-da7eba47ed40 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.772136 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e1fc9-0c19-4e6e-8ab9-da7eba47ed40 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.772417 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e1fc9-0c19-4e6e-8ab9-da7eba47ed40 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.774551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 373/743] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:07.776831 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b74ad-65a0-4a7a-8d2b-6318c09346db admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.781478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bc2e8-3f3b-4581-b14c-d50a3158126b None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.781789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bc2e8-3f3b-4581-b14c-d50a3158126b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.782051 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bc2e8-3f3b-4581-b14c-d50a3158126b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.788885 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b74ad-65a0-4a7a-8d2b-6318c09346db admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.794839 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba11a4-c291-4bac-ade9-f132c929910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.795532 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba11a4-c291-4bac-ade9-f132c929910e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.795808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba11a4-c291-4bac-ade9-f132c929910e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.796078 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba11a4-c291-4bac-ade9-f132c929910e admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.796912 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba11a4-c291-4bac-ade9-f132c929910e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:07.797212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba11a4-c291-4bac-ade9-f132c929910e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.799139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba11a4-c291-4bac-ade9-f132c929910e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.803937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-5d1bc2e8-3f3b-4581-b14c-d50a3158126b None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:07.805174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5d1bc2e8-3f3b-4581-b14c-d50a3158126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:07.814745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 374/744] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:07 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:07.825876 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 371/745] 10.222.0.79 () {56 vars in 1154 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:07.831623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bc2e8-3f3b-4581-b14c-d50a3158126b None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.840016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba11a4-c291-4bac-ade9-f132c929910e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.848251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bc2e8-3f3b-4581-b14c-d50a3158126b None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.856085 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba11a4-c291-4bac-ade9-f132c929910e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.858521 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7bbc7-3f59-441e-8e85-d3267ccb78f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.859350 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7bbc7-3f59-441e-8e85-d3267ccb78f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.859627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7bbc7-3f59-441e-8e85-d3267ccb78f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.859893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7bbc7-3f59-441e-8e85-d3267ccb78f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.872362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543ae10-9fab-4004-8119-294395e03177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.873187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ae10-9fab-4004-8119-294395e03177 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.873469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ae10-9fab-4004-8119-294395e03177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.873741 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ae10-9fab-4004-8119-294395e03177 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.880974 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7bbc7-3f59-441e-8e85-d3267ccb78f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.882852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7bbc7-3f59-441e-8e85-d3267ccb78f4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.896469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543ae10-9fab-4004-8119-294395e03177 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:07.903376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-5543ae10-9fab-4004-8119-294395e03177 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:26:07.905363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 372/746] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:07.915584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-b3e7bbc7-3f59-441e-8e85-d3267ccb78f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:07.916768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 375/747] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:07.917652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543ae10-9fab-4004-8119-294395e03177 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.928163 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7bbc7-3f59-441e-8e85-d3267ccb78f4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.931558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543ae10-9fab-4004-8119-294395e03177 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.936374 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160ab0d-e2f3-4eef-b244-48c78ddecf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.937037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160ab0d-e2f3-4eef-b244-48c78ddecf15 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.937317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160ab0d-e2f3-4eef-b244-48c78ddecf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.937596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160ab0d-e2f3-4eef-b244-48c78ddecf15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.938367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7bbc7-3f59-441e-8e85-d3267ccb78f4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.938620 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160ab0d-e2f3-4eef-b244-48c78ddecf15 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:07.938797 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160ab0d-e2f3-4eef-b244-48c78ddecf15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.940412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160ab0d-e2f3-4eef-b244-48c78ddecf15 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.958232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 373/748] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:07.958487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00b27e-9e4f-4b46-b7f5-ea6ea0ec1e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.958487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00b27e-9e4f-4b46-b7f5-ea6ea0ec1e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.958487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00b27e-9e4f-4b46-b7f5-ea6ea0ec1e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.958487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00b27e-9e4f-4b46-b7f5-ea6ea0ec1e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.959088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00b27e-9e4f-4b46-b7f5-ea6ea0ec1e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:07.959538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00b27e-9e4f-4b46-b7f5-ea6ea0ec1e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:07.961357 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00b27e-9e4f-4b46-b7f5-ea6ea0ec1e5a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:07.974016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160ab0d-e2f3-4eef-b244-48c78ddecf15 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.982375 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 376/749] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:07.984097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a371cd2-7292-4bc7-a6fd-81957ce61c6a None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.984594 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a371cd2-7292-4bc7-a6fd-81957ce61c6a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.985073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a371cd2-7292-4bc7-a6fd-81957ce61c6a None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:07.987223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160ab0d-e2f3-4eef-b244-48c78ddecf15 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:07.987846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 377/750] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:07.988796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a371cd2-7292-4bc7-a6fd-81957ce61c6a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:07.995444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5746b2-269c-4638-9465-ed9f183f6be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:07.996223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5746b2-269c-4638-9465-ed9f183f6be1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:07.996505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5746b2-269c-4638-9465-ed9f183f6be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:07.997006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5746b2-269c-4638-9465-ed9f183f6be1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.003244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a371cd2-7292-4bc7-a6fd-81957ce61c6a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.008168 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d18429-e967-4c42-a72e-5f4fec18ed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.008550 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5746b2-269c-4638-9465-ed9f183f6be1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.009525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d18429-e967-4c42-a72e-5f4fec18ed62 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.010038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d18429-e967-4c42-a72e-5f4fec18ed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.010394 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5746b2-269c-4638-9465-ed9f183f6be1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.010865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d18429-e967-4c42-a72e-5f4fec18ed62 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.019080 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d18429-e967-4c42-a72e-5f4fec18ed62 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.021301 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d18429-e967-4c42-a72e-5f4fec18ed62 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.031043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-0f5746b2-269c-4638-9465-ed9f183f6be1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:08.036767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 374/751] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:08.036767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5695a-1457-4238-9188-75c0c2a205ae None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.036767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5695a-1457-4238-9188-75c0c2a205ae None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.036767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5695a-1457-4238-9188-75c0c2a205ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.041292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-25d18429-e967-4c42-a72e-5f4fec18ed62 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:08.043178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 378/752] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:08.044143 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d18429-e967-4c42-a72e-5f4fec18ed62 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.054026 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d18429-e967-4c42-a72e-5f4fec18ed62 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.054298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-6ef5695a-1457-4238-9188-75c0c2a205ae None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:08.055566 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6ef5695a-1457-4238-9188-75c0c2a205ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:08.059525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5da653-aaba-4126-b505-55f326b26342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.060355 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5da653-aaba-4126-b505-55f326b26342 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.060881 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5da653-aaba-4126-b505-55f326b26342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.061322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5da653-aaba-4126-b505-55f326b26342 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.062260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5da653-aaba-4126-b505-55f326b26342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:08.062807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5da653-aaba-4126-b505-55f326b26342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.064026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 375/753] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:08 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:08.064709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5695a-1457-4238-9188-75c0c2a205ae None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.065412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5da653-aaba-4126-b505-55f326b26342 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.088957 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5695a-1457-4238-9188-75c0c2a205ae None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.092575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 379/754] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:08.097136 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5da653-aaba-4126-b505-55f326b26342 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.101707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1e275-c910-4950-982e-d08cc8cc5ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.102574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1e275-c910-4950-982e-d08cc8cc5ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.103006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1e275-c910-4950-982e-d08cc8cc5ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.103421 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1e275-c910-4950-982e-d08cc8cc5ef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.104448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1e275-c910-4950-982e-d08cc8cc5ef9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:08.104961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1e275-c910-4950-982e-d08cc8cc5ef9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.107061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1e275-c910-4950-982e-d08cc8cc5ef9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.107326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5da653-aaba-4126-b505-55f326b26342 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.112467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fb999-0462-4208-9ffc-3b3a9f512687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.113155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fb999-0462-4208-9ffc-3b3a9f512687 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.113433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fb999-0462-4208-9ffc-3b3a9f512687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.113756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fb999-0462-4208-9ffc-3b3a9f512687 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.114502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fb999-0462-4208-9ffc-3b3a9f512687 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.116655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fb999-0462-4208-9ffc-3b3a9f512687 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.121398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 376/755] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:08.122544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1e275-c910-4950-982e-d08cc8cc5ef9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.134067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1e275-c910-4950-982e-d08cc8cc5ef9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.142281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 380/756] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:26:08 2022] POST /identity/v3/services => generated 240 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:08.143511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fb999-0462-4208-9ffc-3b3a9f512687 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.159844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69df0c9-ee93-4c22-acdc-8764e02d03f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.162395 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69df0c9-ee93-4c22-acdc-8764e02d03f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.163540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69df0c9-ee93-4c22-acdc-8764e02d03f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.165080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69df0c9-ee93-4c22-acdc-8764e02d03f9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.168912 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fb999-0462-4208-9ffc-3b3a9f512687 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.179295 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc357e4-3565-43a2-80a9-c56a7a04d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.180648 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc357e4-3565-43a2-80a9-c56a7a04d240 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.181577 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc357e4-3565-43a2-80a9-c56a7a04d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.183038 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69df0c9-ee93-4c22-acdc-8764e02d03f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.183417 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc357e4-3565-43a2-80a9-c56a7a04d240 admin admin] PATH_INFO: `/v3/projects/0eaab085a52a4171be0afec37707daca/users/333ec5b3842b432a99bc265abbe7fa58/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.188026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69df0c9-ee93-4c22-acdc-8764e02d03f9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.189172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc357e4-3565-43a2-80a9-c56a7a04d240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaab085a52a4171be0afec37707daca, user_id=333ec5b3842b432a99bc265abbe7fa58, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.194047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc357e4-3565-43a2-80a9-c56a7a04d240 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.211987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-b69df0c9-ee93-4c22-acdc-8764e02d03f9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 01:26:08.213816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 377/757] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:08.227544 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 381/758] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:26:08 2022] PUT /identity/v3/projects/0eaab085a52a4171be0afec37707daca/users/333ec5b3842b432a99bc265abbe7fa58/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:26:08.228378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69df0c9-ee93-4c22-acdc-8764e02d03f9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.239309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69df0c9-ee93-4c22-acdc-8764e02d03f9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.302060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a65345-2364-41ff-af8a-2fbc53a9ec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.303209 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a65345-2364-41ff-af8a-2fbc53a9ec0a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.303776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a65345-2364-41ff-af8a-2fbc53a9ec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.304252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a65345-2364-41ff-af8a-2fbc53a9ec0a admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.305307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a65345-2364-41ff-af8a-2fbc53a9ec0a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:08.305857 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a65345-2364-41ff-af8a-2fbc53a9ec0a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.308126 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a65345-2364-41ff-af8a-2fbc53a9ec0a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.333997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 378/759] 10.222.0.79 () {56 vars in 1156 bytes} [Mon Feb 21 01:26:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:08.339833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc357e4-3565-43a2-80a9-c56a7a04d240 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.351761 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc357e4-3565-43a2-80a9-c56a7a04d240 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.357116 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8458d-10e0-40a1-8ae4-dabd092aa124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.358193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8458d-10e0-40a1-8ae4-dabd092aa124 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.358718 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8458d-10e0-40a1-8ae4-dabd092aa124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.359229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8458d-10e0-40a1-8ae4-dabd092aa124 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.372940 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8458d-10e0-40a1-8ae4-dabd092aa124 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.376278 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8458d-10e0-40a1-8ae4-dabd092aa124 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.393371 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 382/760] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:08 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:08.399148 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a65345-2364-41ff-af8a-2fbc53a9ec0a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.410569 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a65345-2364-41ff-af8a-2fbc53a9ec0a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.419187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb135ffa-aedc-4859-8e19-6c8beb17144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.420483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb135ffa-aedc-4859-8e19-6c8beb17144f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.421033 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb135ffa-aedc-4859-8e19-6c8beb17144f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.421530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb135ffa-aedc-4859-8e19-6c8beb17144f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.435504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb135ffa-aedc-4859-8e19-6c8beb17144f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.438624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb135ffa-aedc-4859-8e19-6c8beb17144f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.460319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-bb135ffa-aedc-4859-8e19-6c8beb17144f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:08.462329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 379/761] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:08.468747 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8458d-10e0-40a1-8ae4-dabd092aa124 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.478717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8458d-10e0-40a1-8ae4-dabd092aa124 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.484351 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc716b-5ae0-484e-95be-a03204eb09f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.485428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc716b-5ae0-484e-95be-a03204eb09f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.485963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc716b-5ae0-484e-95be-a03204eb09f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.486538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc716b-5ae0-484e-95be-a03204eb09f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.487536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc716b-5ae0-484e-95be-a03204eb09f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:08.488093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc716b-5ae0-484e-95be-a03204eb09f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.489938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc716b-5ae0-484e-95be-a03204eb09f8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.505745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 383/762] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:08.511182 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb135ffa-aedc-4859-8e19-6c8beb17144f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.521416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb135ffa-aedc-4859-8e19-6c8beb17144f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.526336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060d42-3fd9-494c-91a3-e27b6dad111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.527400 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060d42-3fd9-494c-91a3-e27b6dad111e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.527786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060d42-3fd9-494c-91a3-e27b6dad111e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.528163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060d42-3fd9-494c-91a3-e27b6dad111e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.537891 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7060d42-3fd9-494c-91a3-e27b6dad111e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.540513 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7060d42-3fd9-494c-91a3-e27b6dad111e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.554923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-f7060d42-3fd9-494c-91a3-e27b6dad111e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:08.556678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 380/763] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:08.562418 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc716b-5ae0-484e-95be-a03204eb09f8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.572897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc716b-5ae0-484e-95be-a03204eb09f8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.578530 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e59831-2ee8-443d-aece-943bb96b6404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.579379 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e59831-2ee8-443d-aece-943bb96b6404 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.579767 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e59831-2ee8-443d-aece-943bb96b6404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.580155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e59831-2ee8-443d-aece-943bb96b6404 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.581117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e59831-2ee8-443d-aece-943bb96b6404 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:08.581572 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e59831-2ee8-443d-aece-943bb96b6404 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.583666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e59831-2ee8-443d-aece-943bb96b6404 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.597014 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 384/764] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:08.602412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060d42-3fd9-494c-91a3-e27b6dad111e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.615506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060d42-3fd9-494c-91a3-e27b6dad111e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.626878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc468843-a78c-4533-80e6-d20e71c11726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.627630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc468843-a78c-4533-80e6-d20e71c11726 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.627988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc468843-a78c-4533-80e6-d20e71c11726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.628335 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc468843-a78c-4533-80e6-d20e71c11726 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.629249 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc468843-a78c-4533-80e6-d20e71c11726 admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=0cb0a0d56f0049b19ba22e0dd041897e) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:08.629640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc468843-a78c-4533-80e6-d20e71c11726 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.631601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc468843-a78c-4533-80e6-d20e71c11726 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.642034 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 381/765] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:08 2022] GET /identity/v3/role_assignments?user.id=0cb0a0d56f0049b19ba22e0dd041897e&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=548abad662724741a3261205ee7cb828 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:10.068353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07035206-45a8-4b83-9067-8a1b0a0f8080 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.068880 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07035206-45a8-4b83-9067-8a1b0a0f8080 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.069122 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07035206-45a8-4b83-9067-8a1b0a0f8080 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.071365 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 385/766] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:10.076888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fa06d-3978-43f8-aea7-9d594da16c3c None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.077301 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fa06d-3978-43f8-aea7-9d594da16c3c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.077434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fa06d-3978-43f8-aea7-9d594da16c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.102402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b77fa06d-3978-43f8-aea7-9d594da16c3c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:10.103724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b77fa06d-3978-43f8-aea7-9d594da16c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:10.113219 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 382/767] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:10 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:10.148440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07035206-45a8-4b83-9067-8a1b0a0f8080 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.167684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07035206-45a8-4b83-9067-8a1b0a0f8080 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.178959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94952d8-a2ed-459d-9371-5fd37684ffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.179786 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94952d8-a2ed-459d-9371-5fd37684ffeb admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.180073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94952d8-a2ed-459d-9371-5fd37684ffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.180352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94952d8-a2ed-459d-9371-5fd37684ffeb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.194048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94952d8-a2ed-459d-9371-5fd37684ffeb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:10.200987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-d94952d8-a2ed-459d-9371-5fd37684ffeb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:26:10.203098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 386/768] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:10.208557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fa06d-3978-43f8-aea7-9d594da16c3c None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.223105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fa06d-3978-43f8-aea7-9d594da16c3c None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.233171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b348a2-17ad-412c-b150-a7c90604291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.233831 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b348a2-17ad-412c-b150-a7c90604291b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.234112 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b348a2-17ad-412c-b150-a7c90604291b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.234420 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b348a2-17ad-412c-b150-a7c90604291b admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.235173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b348a2-17ad-412c-b150-a7c90604291b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:10.235477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b348a2-17ad-412c-b150-a7c90604291b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.237070 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b348a2-17ad-412c-b150-a7c90604291b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.249797 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 383/769] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:10.255352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94952d8-a2ed-459d-9371-5fd37684ffeb admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.270706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94952d8-a2ed-459d-9371-5fd37684ffeb admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.282819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d672d8-12ae-41c9-a5f1-0a269751090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.283700 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d672d8-12ae-41c9-a5f1-0a269751090a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.284060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d672d8-12ae-41c9-a5f1-0a269751090a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.284411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d672d8-12ae-41c9-a5f1-0a269751090a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.297352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d672d8-12ae-41c9-a5f1-0a269751090a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.299403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d672d8-12ae-41c9-a5f1-0a269751090a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.309516 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba4197-1139-40f8-90c9-ca5abb6e4f81 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.309804 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba4197-1139-40f8-90c9-ca5abb6e4f81 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.310084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba4197-1139-40f8-90c9-ca5abb6e4f81 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.312173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 384/770] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:26:10.323347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-f7d672d8-12ae-41c9-a5f1-0a269751090a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:10.325029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 387/771] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:10.328172 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a64993-a499-4a7c-b176-095092940635 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.328456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a64993-a499-4a7c-b176-095092940635 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.328730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a64993-a499-4a7c-b176-095092940635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.330559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d672d8-12ae-41c9-a5f1-0a269751090a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.352370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d672d8-12ae-41c9-a5f1-0a269751090a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.360447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b7a64993-a499-4a7c-b176-095092940635 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:10.360714 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cf688-e03f-4a64-b05c-24e2f4e34743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.361379 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cf688-e03f-4a64-b05c-24e2f4e34743 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.361662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cf688-e03f-4a64-b05c-24e2f4e34743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.361783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b7a64993-a499-4a7c-b176-095092940635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:10.361968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cf688-e03f-4a64-b05c-24e2f4e34743 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.362696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6cf688-e03f-4a64-b05c-24e2f4e34743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:10.363002 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6cf688-e03f-4a64-b05c-24e2f4e34743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.364603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6cf688-e03f-4a64-b05c-24e2f4e34743 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.382574 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 388/772] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:10.383927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 385/773] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:10 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:10.387725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cf688-e03f-4a64-b05c-24e2f4e34743 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.404322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cf688-e03f-4a64-b05c-24e2f4e34743 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.416974 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc92000-7814-441c-81e5-f4afff6c4d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.418038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc92000-7814-441c-81e5-f4afff6c4d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.418543 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc92000-7814-441c-81e5-f4afff6c4d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.418965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc92000-7814-441c-81e5-f4afff6c4d58 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.431374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc92000-7814-441c-81e5-f4afff6c4d58 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.433573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc92000-7814-441c-81e5-f4afff6c4d58 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.437826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a64993-a499-4a7c-b176-095092940635 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.447970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a64993-a499-4a7c-b176-095092940635 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.461531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc07d54-caa3-4e30-b918-ce208458f26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.462569 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc07d54-caa3-4e30-b918-ce208458f26c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.463000 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc07d54-caa3-4e30-b918-ce208458f26c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.463506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc07d54-caa3-4e30-b918-ce208458f26c admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.464326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc07d54-caa3-4e30-b918-ce208458f26c admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.467523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-0bc92000-7814-441c-81e5-f4afff6c4d58 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 01:26:10.468040 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc07d54-caa3-4e30-b918-ce208458f26c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.474691 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 389/774] 10.222.0.79 () {56 vars in 1138 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:10.476590 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc92000-7814-441c-81e5-f4afff6c4d58 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.488780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-ddc07d54-caa3-4e30-b918-ce208458f26c admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 01:26:10.494135 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 386/775] 10.222.0.79 () {56 vars in 1150 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:10.495061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc92000-7814-441c-81e5-f4afff6c4d58 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.496913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc07d54-caa3-4e30-b918-ce208458f26c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.505748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33840d6d-2554-401c-a882-9f809d2060f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.506438 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33840d6d-2554-401c-a882-9f809d2060f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.506718 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33840d6d-2554-401c-a882-9f809d2060f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.506988 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33840d6d-2554-401c-a882-9f809d2060f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.507818 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33840d6d-2554-401c-a882-9f809d2060f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:10.508118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33840d6d-2554-401c-a882-9f809d2060f6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.509942 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33840d6d-2554-401c-a882-9f809d2060f6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.520987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc07d54-caa3-4e30-b918-ce208458f26c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.530345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa073f40-86bf-47c6-be48-121799f10ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.531003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa073f40-86bf-47c6-be48-121799f10ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.531279 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa073f40-86bf-47c6-be48-121799f10ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.531548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa073f40-86bf-47c6-be48-121799f10ec3 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.532252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa073f40-86bf-47c6-be48-121799f10ec3 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:10.532548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa073f40-86bf-47c6-be48-121799f10ec3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.534128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa073f40-86bf-47c6-be48-121799f10ec3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.541293 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 390/776] 10.222.0.79 () {56 vars in 1170 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:10.547054 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 387/777] 10.222.0.79 () {56 vars in 1145 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:10.548308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33840d6d-2554-401c-a882-9f809d2060f6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.552809 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa073f40-86bf-47c6-be48-121799f10ec3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.565504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33840d6d-2554-401c-a882-9f809d2060f6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.568100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa073f40-86bf-47c6-be48-121799f10ec3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.574669 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ecc21-d386-4b3a-873a-f6a0fe371ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.575388 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ecc21-d386-4b3a-873a-f6a0fe371ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.575664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ecc21-d386-4b3a-873a-f6a0fe371ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.575931 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ecc21-d386-4b3a-873a-f6a0fe371ca4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.578497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfbfa1-dd70-49ab-aaf4-82f1eb2459f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.579141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfbfa1-dd70-49ab-aaf4-82f1eb2459f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.579417 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfbfa1-dd70-49ab-aaf4-82f1eb2459f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.579679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfbfa1-dd70-49ab-aaf4-82f1eb2459f3 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.580376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfbfa1-dd70-49ab-aaf4-82f1eb2459f3 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:10.580680 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfbfa1-dd70-49ab-aaf4-82f1eb2459f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.582315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfbfa1-dd70-49ab-aaf4-82f1eb2459f3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.594668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 388/778] 10.222.0.79 () {56 vars in 1145 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:10.596549 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ecc21-d386-4b3a-873a-f6a0fe371ca4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.598498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ecc21-d386-4b3a-873a-f6a0fe371ca4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.599301 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfbfa1-dd70-49ab-aaf4-82f1eb2459f3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.614983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfbfa1-dd70-49ab-aaf4-82f1eb2459f3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.640893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe118bd-dc8d-446c-87c7-6929e89a5199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.641723 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe118bd-dc8d-446c-87c7-6929e89a5199 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.642131 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe118bd-dc8d-446c-87c7-6929e89a5199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.642531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe118bd-dc8d-446c-87c7-6929e89a5199 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.643436 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe118bd-dc8d-446c-87c7-6929e89a5199 admin admin] RBAC: Adding query filter params (interface=public, service_id=10329dd7bd704876826e9183c8a7f5f7, region_id=RegionOne) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:10.643895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe118bd-dc8d-446c-87c7-6929e89a5199 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.645015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-dbe118bd-dc8d-446c-87c7-6929e89a5199 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:26:10.645015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:26:10.645015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:26:10.647767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe118bd-dc8d-446c-87c7-6929e89a5199 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.650272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-b60ecc21-d386-4b3a-873a-f6a0fe371ca4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:10.651623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 391/779] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:10.657536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ecc21-d386-4b3a-873a-f6a0fe371ca4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.664160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 389/780] 10.222.0.79 () {56 vars in 1272 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/endpoints?service_id=10329dd7bd704876826e9183c8a7f5f7&interface=public®ion_id=RegionOne => generated 194 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:10.669729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe118bd-dc8d-446c-87c7-6929e89a5199 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.671685 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ecc21-d386-4b3a-873a-f6a0fe371ca4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.683662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ac419-5a6c-4169-b47a-e392672e3177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.684535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ac419-5a6c-4169-b47a-e392672e3177 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.686300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ac419-5a6c-4169-b47a-e392672e3177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.686693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ac419-5a6c-4169-b47a-e392672e3177 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.687538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ac419-5a6c-4169-b47a-e392672e3177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:10.688686 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe118bd-dc8d-446c-87c7-6929e89a5199 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.689199 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ac419-5a6c-4169-b47a-e392672e3177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.691615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ac419-5a6c-4169-b47a-e392672e3177 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.702072 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92b530-9648-4870-a732-0a6f39338203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.702943 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92b530-9648-4870-a732-0a6f39338203 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.703328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92b530-9648-4870-a732-0a6f39338203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.703711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92b530-9648-4870-a732-0a6f39338203 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.704558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92b530-9648-4870-a732-0a6f39338203 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.709660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92b530-9648-4870-a732-0a6f39338203 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.715926 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 392/781] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:10.719215 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 390/782] 10.222.0.79 () {56 vars in 1108 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/services => generated 772 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:10.721457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ac419-5a6c-4169-b47a-e392672e3177 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.732187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ac419-5a6c-4169-b47a-e392672e3177 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.737775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96c1eb-b207-43d4-bad5-5beaeb394e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.738775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c1eb-b207-43d4-bad5-5beaeb394e6a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.739166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c1eb-b207-43d4-bad5-5beaeb394e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.739584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c1eb-b207-43d4-bad5-5beaeb394e6a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.748089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96c1eb-b207-43d4-bad5-5beaeb394e6a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.750712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96c1eb-b207-43d4-bad5-5beaeb394e6a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.766076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-cf96c1eb-b207-43d4-bad5-5beaeb394e6a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:10.767957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 393/783] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:10.775443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92b530-9648-4870-a732-0a6f39338203 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.793060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92b530-9648-4870-a732-0a6f39338203 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.799198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c90f7b-b975-44a9-9efd-5b2e47d72636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.800027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c90f7b-b975-44a9-9efd-5b2e47d72636 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.800416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c90f7b-b975-44a9-9efd-5b2e47d72636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.800856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c90f7b-b975-44a9-9efd-5b2e47d72636 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.801779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c90f7b-b975-44a9-9efd-5b2e47d72636 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:10.802228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c90f7b-b975-44a9-9efd-5b2e47d72636 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.804331 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c90f7b-b975-44a9-9efd-5b2e47d72636 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.823575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 391/784] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:10.829809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96c1eb-b207-43d4-bad5-5beaeb394e6a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:10.846157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96c1eb-b207-43d4-bad5-5beaeb394e6a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:10.857204 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbd1e1-95c6-411b-bcb2-9750942ec31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:10.858304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbd1e1-95c6-411b-bcb2-9750942ec31c admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:10.858760 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbd1e1-95c6-411b-bcb2-9750942ec31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:10.859149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbd1e1-95c6-411b-bcb2-9750942ec31c admin admin] PATH_INFO: `/v3/projects/0eaab085a52a4171be0afec37707daca/users/19893604215b4bd397178347775e0bb2/roles/8a020c6e5d94457ca1f453a3531c89b2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:10.878484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbd1e1-95c6-411b-bcb2-9750942ec31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaab085a52a4171be0afec37707daca, user_id=19893604215b4bd397178347775e0bb2, role_id=8a020c6e5d94457ca1f453a3531c89b2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:10.881420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbd1e1-95c6-411b-bcb2-9750942ec31c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:10.898710 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 394/785] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:26:10 2022] PUT /identity/v3/projects/0eaab085a52a4171be0afec37707daca/users/19893604215b4bd397178347775e0bb2/roles/8a020c6e5d94457ca1f453a3531c89b2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:26:11.176244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f540-5b7b-4f93-9216-22ecfba073fd None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.176903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f540-5b7b-4f93-9216-22ecfba073fd None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.176903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f540-5b7b-4f93-9216-22ecfba073fd None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.178882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 392/786] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:11.186986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e08d7d-fa3e-44f8-b466-7d855fce0afc None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.186986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e08d7d-fa3e-44f8-b466-7d855fce0afc None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.186986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e08d7d-fa3e-44f8-b466-7d855fce0afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.215983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-b9e08d7d-fa3e-44f8-b466-7d855fce0afc None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:11.217952 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b9e08d7d-fa3e-44f8-b466-7d855fce0afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:11.257675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee0b1f-dc3b-423f-90fd-5a697a92579b None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.258135 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee0b1f-dc3b-423f-90fd-5a697a92579b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.258488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee0b1f-dc3b-423f-90fd-5a697a92579b None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.260368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 393/787] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:11.265523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb269f1-10b1-40af-9218-e4e305bb1524 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.265932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb269f1-10b1-40af-9218-e4e305bb1524 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.266385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb269f1-10b1-40af-9218-e4e305bb1524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.302743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 395/788] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:11 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:11.304021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-1bb269f1-10b1-40af-9218-e4e305bb1524 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:11.305377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1bb269f1-10b1-40af-9218-e4e305bb1524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:11.321329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 394/789] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:11 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:11.325684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e08d7d-fa3e-44f8-b466-7d855fce0afc None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.334960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e08d7d-fa3e-44f8-b466-7d855fce0afc None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.346505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a33ec-886b-47d2-a094-114487d7737d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.347309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a33ec-886b-47d2-a094-114487d7737d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.347595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a33ec-886b-47d2-a094-114487d7737d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.347870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a33ec-886b-47d2-a094-114487d7737d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.358810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb269f1-10b1-40af-9218-e4e305bb1524 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.362473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a33ec-886b-47d2-a094-114487d7737d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:11.369626 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-791a33ec-886b-47d2-a094-114487d7737d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:26:11.371782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 396/790] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:11.378465 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a33ec-886b-47d2-a094-114487d7737d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.379917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb269f1-10b1-40af-9218-e4e305bb1524 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.389863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e2fb0-6c7b-416e-8418-f2a41d84f182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.390936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e2fb0-6c7b-416e-8418-f2a41d84f182 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.391411 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e2fb0-6c7b-416e-8418-f2a41d84f182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.391844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e2fb0-6c7b-416e-8418-f2a41d84f182 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.393326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e2fb0-6c7b-416e-8418-f2a41d84f182 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.396317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e2fb0-6c7b-416e-8418-f2a41d84f182 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.399155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a33ec-886b-47d2-a094-114487d7737d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.413269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc9fc-bd6f-4494-b579-cf630739ef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.414122 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc9fc-bd6f-4494-b579-cf630739ef76 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.414632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc9fc-bd6f-4494-b579-cf630739ef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.415047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc9fc-bd6f-4494-b579-cf630739ef76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.415985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dc9fc-bd6f-4494-b579-cf630739ef76 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:11.416433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dc9fc-bd6f-4494-b579-cf630739ef76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.419922 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dc9fc-bd6f-4494-b579-cf630739ef76 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.422737 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-879e2fb0-6c7b-416e-8418-f2a41d84f182 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 01:26:11.425514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 395/791] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/services/network => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:11.433867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 397/792] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:11.434997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e2fb0-6c7b-416e-8418-f2a41d84f182 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.448433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc9fc-bd6f-4494-b579-cf630739ef76 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.456776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e2fb0-6c7b-416e-8418-f2a41d84f182 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.458997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc9fc-bd6f-4494-b579-cf630739ef76 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.468165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccfb70-934d-4a87-a010-493791b0c580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.469261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756aa9e-a6af-406a-aa2c-a023c057b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.469445 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccfb70-934d-4a87-a010-493791b0c580 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.470274 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756aa9e-a6af-406a-aa2c-a023c057b810 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.470741 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccfb70-934d-4a87-a010-493791b0c580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.471157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccfb70-934d-4a87-a010-493791b0c580 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.472156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756aa9e-a6af-406a-aa2c-a023c057b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.472572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756aa9e-a6af-406a-aa2c-a023c057b810 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.474825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756aa9e-a6af-406a-aa2c-a023c057b810 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:11.475295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756aa9e-a6af-406a-aa2c-a023c057b810 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.477059 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756aa9e-a6af-406a-aa2c-a023c057b810 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.487104 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 396/793] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:11.490950 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccfb70-934d-4a87-a010-493791b0c580 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.493081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccfb70-934d-4a87-a010-493791b0c580 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.494029 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756aa9e-a6af-406a-aa2c-a023c057b810 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.506428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756aa9e-a6af-406a-aa2c-a023c057b810 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.511276 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662a6c0-1359-4d2f-b19e-f24ef8383a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.512115 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662a6c0-1359-4d2f-b19e-f24ef8383a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.512564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662a6c0-1359-4d2f-b19e-f24ef8383a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.513091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662a6c0-1359-4d2f-b19e-f24ef8383a7b admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.514536 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662a6c0-1359-4d2f-b19e-f24ef8383a7b admin admin] RBAC: Adding query filter params (type=network) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:11.514997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662a6c0-1359-4d2f-b19e-f24ef8383a7b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.516817 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662a6c0-1359-4d2f-b19e-f24ef8383a7b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.518693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-73ccfb70-934d-4a87-a010-493791b0c580 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:11.520786 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 398/794] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:11.526880 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 397/795] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:11.527642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccfb70-934d-4a87-a010-493791b0c580 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.542068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccfb70-934d-4a87-a010-493791b0c580 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.544039 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662a6c0-1359-4d2f-b19e-f24ef8383a7b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.546934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a6bc7-6618-406c-aae6-a7bbb77e344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.547588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6bc7-6618-406c-aae6-a7bbb77e344b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.547969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6bc7-6618-406c-aae6-a7bbb77e344b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.548255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6bc7-6618-406c-aae6-a7bbb77e344b admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.548979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a6bc7-6618-406c-aae6-a7bbb77e344b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:11.549290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a6bc7-6618-406c-aae6-a7bbb77e344b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.554245 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a6bc7-6618-406c-aae6-a7bbb77e344b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.562043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662a6c0-1359-4d2f-b19e-f24ef8383a7b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.564228 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 399/796] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:11.572473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a6bc7-6618-406c-aae6-a7bbb77e344b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.572986 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bf66c-f208-4adc-91fe-26f56174fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.573887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bf66c-f208-4adc-91fe-26f56174fc79 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.574337 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bf66c-f208-4adc-91fe-26f56174fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.574870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bf66c-f208-4adc-91fe-26f56174fc79 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.575912 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bf66c-f208-4adc-91fe-26f56174fc79 admin admin] RBAC: Adding query filter params (interface=public, service_id=95c22243cb484faf98eb4137c7604f6c, region_id=RegionOne) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:11.576889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bf66c-f208-4adc-91fe-26f56174fc79 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.578753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bf66c-f208-4adc-91fe-26f56174fc79 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.584799 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 398/797] 10.222.0.79 () {56 vars in 1272 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/endpoints?service_id=95c22243cb484faf98eb4137c7604f6c&interface=public®ion_id=RegionOne => generated 194 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:11.589815 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a6bc7-6618-406c-aae6-a7bbb77e344b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.590847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bf66c-f208-4adc-91fe-26f56174fc79 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.603316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6aab6-9106-455b-8eeb-c055467aa5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.605992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6aab6-9106-455b-8eeb-c055467aa5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.606485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6aab6-9106-455b-8eeb-c055467aa5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.606823 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bf66c-f208-4adc-91fe-26f56174fc79 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.607260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6aab6-9106-455b-8eeb-c055467aa5f3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.616106 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd7018-82b2-4392-8d5e-7fa08ecb19af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.617454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd7018-82b2-4392-8d5e-7fa08ecb19af admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.620009 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd7018-82b2-4392-8d5e-7fa08ecb19af admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.620493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd7018-82b2-4392-8d5e-7fa08ecb19af admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.621375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd7018-82b2-4392-8d5e-7fa08ecb19af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.623847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd7018-82b2-4392-8d5e-7fa08ecb19af admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.626233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6aab6-9106-455b-8eeb-c055467aa5f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.628516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6aab6-9106-455b-8eeb-c055467aa5f3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.635210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 399/798] 10.222.0.79 () {56 vars in 1108 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/services => generated 772 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:11.647618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-dcd6aab6-9106-455b-8eeb-c055467aa5f3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:26:11.648326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11687280-5b02-46ab-a005-a07c14a667d3 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.648612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11687280-5b02-46ab-a005-a07c14a667d3 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.648886 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11687280-5b02-46ab-a005-a07c14a667d3 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.649826 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 400/799] 10.222.0.79 () {56 vars in 1114 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:11.655084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 400/800] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:26:11.656984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6aab6-9106-455b-8eeb-c055467aa5f3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.662759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b87ba-7f09-4324-909c-fd0ba5997ca7 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.663291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b87ba-7f09-4324-909c-fd0ba5997ca7 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.663761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b87ba-7f09-4324-909c-fd0ba5997ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.679830 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6aab6-9106-455b-8eeb-c055467aa5f3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.691953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fc1cd-ee9d-4e7c-ad26-4239c9128fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.692936 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fc1cd-ee9d-4e7c-ad26-4239c9128fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.693536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fc1cd-ee9d-4e7c-ad26-4239c9128fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.694619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fc1cd-ee9d-4e7c-ad26-4239c9128fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.695610 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fc1cd-ee9d-4e7c-ad26-4239c9128fc1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:11.696041 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fc1cd-ee9d-4e7c-ad26-4239c9128fc1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.698037 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fc1cd-ee9d-4e7c-ad26-4239c9128fc1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.698167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b66b87ba-7f09-4324-909c-fd0ba5997ca7 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:11.699566 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b66b87ba-7f09-4324-909c-fd0ba5997ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:11.724864 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 401/801] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:11 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:11.743996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 401/802] 10.222.0.79 () {56 vars in 1154 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:11.745521 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b87ba-7f09-4324-909c-fd0ba5997ca7 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.757269 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b87ba-7f09-4324-909c-fd0ba5997ca7 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.762395 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839886e-0382-42b2-8299-50163a304cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.764114 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839886e-0382-42b2-8299-50163a304cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.764595 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839886e-0382-42b2-8299-50163a304cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.765065 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839886e-0382-42b2-8299-50163a304cf6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.771292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fc1cd-ee9d-4e7c-ad26-4239c9128fc1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.785487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fc1cd-ee9d-4e7c-ad26-4239c9128fc1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.793910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d67878-55cf-4e49-8faf-b54de944dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.795879 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d67878-55cf-4e49-8faf-b54de944dcae admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.796211 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d67878-55cf-4e49-8faf-b54de944dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.796809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d67878-55cf-4e49-8faf-b54de944dcae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.798393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839886e-0382-42b2-8299-50163a304cf6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:11.812981 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-7839886e-0382-42b2-8299-50163a304cf6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:26:11.814758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d67878-55cf-4e49-8faf-b54de944dcae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.816585 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d67878-55cf-4e49-8faf-b54de944dcae admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.819102 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 402/803] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:11.827084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839886e-0382-42b2-8299-50163a304cf6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.832255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 402/804] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:11.838248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d67878-55cf-4e49-8faf-b54de944dcae admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.841658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839886e-0382-42b2-8299-50163a304cf6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.846599 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1a74c-2e2a-483f-87b9-dcfd85e9608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.847273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1a74c-2e2a-483f-87b9-dcfd85e9608c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.847603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1a74c-2e2a-483f-87b9-dcfd85e9608c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.847876 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1a74c-2e2a-483f-87b9-dcfd85e9608c admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.848447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d67878-55cf-4e49-8faf-b54de944dcae admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.848678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1a74c-2e2a-483f-87b9-dcfd85e9608c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:11.848983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1a74c-2e2a-483f-87b9-dcfd85e9608c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.850964 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1a74c-2e2a-483f-87b9-dcfd85e9608c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.854256 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fc842-610b-4c70-84d3-53bf66d9525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.855197 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fc842-610b-4c70-84d3-53bf66d9525f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.855594 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fc842-610b-4c70-84d3-53bf66d9525f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.855977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fc842-610b-4c70-84d3-53bf66d9525f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.864593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 403/805] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:11.870167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1a74c-2e2a-483f-87b9-dcfd85e9608c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.871081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fc842-610b-4c70-84d3-53bf66d9525f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.873621 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fc842-610b-4c70-84d3-53bf66d9525f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.880968 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1a74c-2e2a-483f-87b9-dcfd85e9608c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.886458 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb068e-77b9-4fbd-b6cb-a7e79d0b85d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.887351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb068e-77b9-4fbd-b6cb-a7e79d0b85d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.887626 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb068e-77b9-4fbd-b6cb-a7e79d0b85d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.887939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb068e-77b9-4fbd-b6cb-a7e79d0b85d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.894454 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-d22fc842-610b-4c70-84d3-53bf66d9525f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:11.897320 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 403/806] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:11.902444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fc842-610b-4c70-84d3-53bf66d9525f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.903543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb068e-77b9-4fbd-b6cb-a7e79d0b85d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.906084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb068e-77b9-4fbd-b6cb-a7e79d0b85d2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.915140 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fc842-610b-4c70-84d3-53bf66d9525f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.920960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab7d72-dfd7-4005-9723-3d29dec1e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.921618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab7d72-dfd7-4005-9723-3d29dec1e334 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.921901 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab7d72-dfd7-4005-9723-3d29dec1e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.922184 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab7d72-dfd7-4005-9723-3d29dec1e334 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.923037 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab7d72-dfd7-4005-9723-3d29dec1e334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:11.923341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab7d72-dfd7-4005-9723-3d29dec1e334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.924931 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab7d72-dfd7-4005-9723-3d29dec1e334 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.928518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-74cb068e-77b9-4fbd-b6cb-a7e79d0b85d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:11.930180 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 404/807] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:11.935781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb068e-77b9-4fbd-b6cb-a7e79d0b85d2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.937402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 404/808] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:11.946801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab7d72-dfd7-4005-9723-3d29dec1e334 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.949975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb068e-77b9-4fbd-b6cb-a7e79d0b85d2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.955530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0c2da-48e2-410a-952d-e0e3b1567a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.956284 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0c2da-48e2-410a-952d-e0e3b1567a71 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.956633 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0c2da-48e2-410a-952d-e0e3b1567a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.956979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0c2da-48e2-410a-952d-e0e3b1567a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.957775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0c2da-48e2-410a-952d-e0e3b1567a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:11.958147 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0c2da-48e2-410a-952d-e0e3b1567a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.959113 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab7d72-dfd7-4005-9723-3d29dec1e334 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:11.960020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0c2da-48e2-410a-952d-e0e3b1567a71 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.964657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687758ea-23f0-4a9c-8ecc-13431c5bd7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:11.965532 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687758ea-23f0-4a9c-8ecc-13431c5bd7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:11.965887 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687758ea-23f0-4a9c-8ecc-13431c5bd7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:11.966306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687758ea-23f0-4a9c-8ecc-13431c5bd7d5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:11.976753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 405/809] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:11.977486 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687758ea-23f0-4a9c-8ecc-13431c5bd7d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:11.979451 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687758ea-23f0-4a9c-8ecc-13431c5bd7d5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:11.984489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0c2da-48e2-410a-952d-e0e3b1567a71 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:11.995779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0c2da-48e2-410a-952d-e0e3b1567a71 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:12.000907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e5ce3-fe45-4589-8978-245ad9f880e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:12.001829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e5ce3-fe45-4589-8978-245ad9f880e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:12.002003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-687758ea-23f0-4a9c-8ecc-13431c5bd7d5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:12.002359 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e5ce3-fe45-4589-8978-245ad9f880e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:12.002745 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e5ce3-fe45-4589-8978-245ad9f880e8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:12.003270 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 405/810] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:12.008748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687758ea-23f0-4a9c-8ecc-13431c5bd7d5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:12.015394 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e5ce3-fe45-4589-8978-245ad9f880e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:12.018505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e5ce3-fe45-4589-8978-245ad9f880e8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:12.020219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687758ea-23f0-4a9c-8ecc-13431c5bd7d5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:12.025271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f70403-f9e9-479b-be0c-4a273569b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:12.025962 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f70403-f9e9-479b-be0c-4a273569b2dc admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:12.026267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f70403-f9e9-479b-be0c-4a273569b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:12.026547 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f70403-f9e9-479b-be0c-4a273569b2dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:12.027427 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f70403-f9e9-479b-be0c-4a273569b2dc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:12.027735 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f70403-f9e9-479b-be0c-4a273569b2dc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:12.030270 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f70403-f9e9-479b-be0c-4a273569b2dc admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:12.034914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-745e5ce3-fe45-4589-8978-245ad9f880e8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 01:26:12.038306 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 406/811] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:12.043818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e5ce3-fe45-4589-8978-245ad9f880e8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:12.048737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 406/812] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:12.054573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f70403-f9e9-479b-be0c-4a273569b2dc admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:12.055908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e5ce3-fe45-4589-8978-245ad9f880e8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:12.061141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7c9b8-8ee6-4b81-a85d-088d897137a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:12.061806 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7c9b8-8ee6-4b81-a85d-088d897137a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:12.062091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7c9b8-8ee6-4b81-a85d-088d897137a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:12.062394 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7c9b8-8ee6-4b81-a85d-088d897137a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:12.063287 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7c9b8-8ee6-4b81-a85d-088d897137a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:12.063647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7c9b8-8ee6-4b81-a85d-088d897137a5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:12.065507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7c9b8-8ee6-4b81-a85d-088d897137a5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:12.071923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f70403-f9e9-479b-be0c-4a273569b2dc admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:12.079903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e671607-7b6f-4b28-8c18-c6e7b35d883a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:12.080727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e671607-7b6f-4b28-8c18-c6e7b35d883a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:12.081111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e671607-7b6f-4b28-8c18-c6e7b35d883a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:12.081498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e671607-7b6f-4b28-8c18-c6e7b35d883a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:12.082513 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e671607-7b6f-4b28-8c18-c6e7b35d883a admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=333ec5b3842b432a99bc265abbe7fa58) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:12.083003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e671607-7b6f-4b28-8c18-c6e7b35d883a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:12.085044 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e671607-7b6f-4b28-8c18-c6e7b35d883a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:12.100960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 407/813] 10.222.0.79 () {56 vars in 1156 bytes} [Mon Feb 21 01:26:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:12.100960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7c9b8-8ee6-4b81-a85d-088d897137a5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:12.103904 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 407/814] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:12 2022] GET /identity/v3/role_assignments?user.id=333ec5b3842b432a99bc265abbe7fa58&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=548abad662724741a3261205ee7cb828 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:12.104849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7c9b8-8ee6-4b81-a85d-088d897137a5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:12.108879 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55971a-446a-4309-bb55-a17c86aed588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:12.109700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55971a-446a-4309-bb55-a17c86aed588 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:12.109986 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55971a-446a-4309-bb55-a17c86aed588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:12.110400 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55971a-446a-4309-bb55-a17c86aed588 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:12.121911 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55971a-446a-4309-bb55-a17c86aed588 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:12.124330 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55971a-446a-4309-bb55-a17c86aed588 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:12.143607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-1d55971a-446a-4309-bb55-a17c86aed588 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:12.149533 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 408/815] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:12.150966 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e671607-7b6f-4b28-8c18-c6e7b35d883a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:12.161369 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e671607-7b6f-4b28-8c18-c6e7b35d883a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:12.166101 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ccf8-cf1a-453b-a07d-b086f506e661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:12.166872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ccf8-cf1a-453b-a07d-b086f506e661 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:12.167159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ccf8-cf1a-453b-a07d-b086f506e661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:12.167435 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ccf8-cf1a-453b-a07d-b086f506e661 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:12.168269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4ccf8-cf1a-453b-a07d-b086f506e661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:12.168576 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4ccf8-cf1a-453b-a07d-b086f506e661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:12.170373 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4ccf8-cf1a-453b-a07d-b086f506e661 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:12.184854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 408/816] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:12.191212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55971a-446a-4309-bb55-a17c86aed588 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:12.202551 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55971a-446a-4309-bb55-a17c86aed588 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:12.207787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b22644-395d-447e-9791-795df6109fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:12.208670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b22644-395d-447e-9791-795df6109fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:12.209010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b22644-395d-447e-9791-795df6109fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:12.209289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b22644-395d-447e-9791-795df6109fe1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:12.217824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b22644-395d-447e-9791-795df6109fe1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:12.220090 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b22644-395d-447e-9791-795df6109fe1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:12.234909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-91b22644-395d-447e-9791-795df6109fe1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:12.241230 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 409/817] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:12.242678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ccf8-cf1a-453b-a07d-b086f506e661 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:12.253838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ccf8-cf1a-453b-a07d-b086f506e661 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:12.258557 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234a122-adcf-4dbb-b954-2fd2504c6526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:12.259292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234a122-adcf-4dbb-b954-2fd2504c6526 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:12.259576 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234a122-adcf-4dbb-b954-2fd2504c6526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:12.259909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234a122-adcf-4dbb-b954-2fd2504c6526 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:12.260739 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234a122-adcf-4dbb-b954-2fd2504c6526 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:12.261110 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234a122-adcf-4dbb-b954-2fd2504c6526 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:12.263104 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234a122-adcf-4dbb-b954-2fd2504c6526 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:12.281731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 409/818] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:12.283076 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b22644-395d-447e-9791-795df6109fe1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:12.301939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b22644-395d-447e-9791-795df6109fe1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:12.316063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13384edb-4700-4ea9-957a-1a5fb3cbf9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:12.316974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384edb-4700-4ea9-957a-1a5fb3cbf9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:12.317258 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384edb-4700-4ea9-957a-1a5fb3cbf9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:12.317532 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384edb-4700-4ea9-957a-1a5fb3cbf9c7 admin admin] PATH_INFO: `/v3/projects/0eaab085a52a4171be0afec37707daca/users/0cb0a0d56f0049b19ba22e0dd041897e/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:12.323751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13384edb-4700-4ea9-957a-1a5fb3cbf9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaab085a52a4171be0afec37707daca, user_id=0cb0a0d56f0049b19ba22e0dd041897e, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:12.326595 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13384edb-4700-4ea9-957a-1a5fb3cbf9c7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:12.364564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 410/819] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:26:12 2022] PUT /identity/v3/projects/0eaab085a52a4171be0afec37707daca/users/0cb0a0d56f0049b19ba22e0dd041897e/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:26:13.649396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd0d0-1bcf-43ee-8fa9-9e7e8ca67a33 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:13.650005 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd0d0-1bcf-43ee-8fa9-9e7e8ca67a33 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:13.650272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd0d0-1bcf-43ee-8fa9-9e7e8ca67a33 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:13.652261 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 410/820] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:13.658098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98654a-59b2-4614-a9b9-c912c56d9c34 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:13.658634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98654a-59b2-4614-a9b9-c912c56d9c34 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:13.658798 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98654a-59b2-4614-a9b9-c912c56d9c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:13.683236 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-6b98654a-59b2-4614-a9b9-c912c56d9c34 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:13.684476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6b98654a-59b2-4614-a9b9-c912c56d9c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:13.765749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 411/821] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:13 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:13.790692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607973-dd7e-4d26-b3b3-f73c8fb23bc5 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:13.790692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607973-dd7e-4d26-b3b3-f73c8fb23bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:13.790692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607973-dd7e-4d26-b3b3-f73c8fb23bc5 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:13.791527 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 411/822] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:13.795769 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98654a-59b2-4614-a9b9-c912c56d9c34 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:13.799372 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f113c7f-f3ea-4e40-994d-86db0eaab9ed None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:13.799894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f113c7f-f3ea-4e40-994d-86db0eaab9ed None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:13.800634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f113c7f-f3ea-4e40-994d-86db0eaab9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:13.811695 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98654a-59b2-4614-a9b9-c912c56d9c34 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:13.825745 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f890a7-1063-4d49-ac98-3114ccd25ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:13.827915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f890a7-1063-4d49-ac98-3114ccd25ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:13.828529 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f890a7-1063-4d49-ac98-3114ccd25ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:13.829021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f890a7-1063-4d49-ac98-3114ccd25ce9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:13.830624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-1f113c7f-f3ea-4e40-994d-86db0eaab9ed None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:13.832195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-1f113c7f-f3ea-4e40-994d-86db0eaab9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:13.845214 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f890a7-1063-4d49-ac98-3114ccd25ce9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:13.852646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-e1f890a7-1063-4d49-ac98-3114ccd25ce9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:26:13.854218 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 412/823] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:26:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:13.855268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 412/824] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:13 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:13.866547 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f890a7-1063-4d49-ac98-3114ccd25ce9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:13.877086 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f890a7-1063-4d49-ac98-3114ccd25ce9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:13.886106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f113c7f-f3ea-4e40-994d-86db0eaab9ed None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:13.891787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138202e3-e634-4dd1-a5f2-f3f51655d06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:13.892468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138202e3-e634-4dd1-a5f2-f3f51655d06d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:13.892752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138202e3-e634-4dd1-a5f2-f3f51655d06d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:13.893026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138202e3-e634-4dd1-a5f2-f3f51655d06d admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:13.893941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138202e3-e634-4dd1-a5f2-f3f51655d06d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:13.894270 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138202e3-e634-4dd1-a5f2-f3f51655d06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:13.896436 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138202e3-e634-4dd1-a5f2-f3f51655d06d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:13.905247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f113c7f-f3ea-4e40-994d-86db0eaab9ed None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:13.907466 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 413/825] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:26:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:13.912975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138202e3-e634-4dd1-a5f2-f3f51655d06d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:13.921811 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd2ee0-2876-499d-84fe-f089aeb1ae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:13.923115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd2ee0-2876-499d-84fe-f089aeb1ae78 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:13.925224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138202e3-e634-4dd1-a5f2-f3f51655d06d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:13.925667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd2ee0-2876-499d-84fe-f089aeb1ae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:13.926094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd2ee0-2876-499d-84fe-f089aeb1ae78 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:13.926928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd2ee0-2876-499d-84fe-f089aeb1ae78 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:13.928669 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd2ee0-2876-499d-84fe-f089aeb1ae78 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:13.935853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e67073-edf8-459c-a425-88efbef29cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:13.937657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67073-edf8-459c-a425-88efbef29cec admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:13.938372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67073-edf8-459c-a425-88efbef29cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:13.946128 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-51dd2ee0-2876-499d-84fe-f089aeb1ae78 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 01:26:13.946596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67073-edf8-459c-a425-88efbef29cec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:13.956634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 413/826] 10.222.0.79 () {56 vars in 1150 bytes} [Mon Feb 21 01:26:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:13.963229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd2ee0-2876-499d-84fe-f089aeb1ae78 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:13.964159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e67073-edf8-459c-a425-88efbef29cec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:13.967610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e67073-edf8-459c-a425-88efbef29cec admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:13.982508 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd2ee0-2876-499d-84fe-f089aeb1ae78 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:13.989505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0399740-35fd-4f55-91c0-38c2f6155eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:13.996099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0399740-35fd-4f55-91c0-38c2f6155eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:13.996547 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0399740-35fd-4f55-91c0-38c2f6155eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:13.996983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0399740-35fd-4f55-91c0-38c2f6155eb1 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:13.997856 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0399740-35fd-4f55-91c0-38c2f6155eb1 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:13.998336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0399740-35fd-4f55-91c0-38c2f6155eb1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.000311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0399740-35fd-4f55-91c0-38c2f6155eb1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.003025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-e5e67073-edf8-459c-a425-88efbef29cec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:14.010521 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 414/827] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:14.012335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 414/828] 10.222.0.79 () {56 vars in 1145 bytes} [Mon Feb 21 01:26:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:14.018486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e67073-edf8-459c-a425-88efbef29cec admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.019454 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0399740-35fd-4f55-91c0-38c2f6155eb1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.036624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0399740-35fd-4f55-91c0-38c2f6155eb1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.039061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e67073-edf8-459c-a425-88efbef29cec admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.047930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534c320-efd9-4ba3-9a6e-95d5a1437b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.048773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453e105-e9a2-4e9e-a47b-087605d7f820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.049605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453e105-e9a2-4e9e-a47b-087605d7f820 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.050427 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534c320-efd9-4ba3-9a6e-95d5a1437b79 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.050869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453e105-e9a2-4e9e-a47b-087605d7f820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.051288 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534c320-efd9-4ba3-9a6e-95d5a1437b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.051704 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453e105-e9a2-4e9e-a47b-087605d7f820 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.052128 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534c320-efd9-4ba3-9a6e-95d5a1437b79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.052978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453e105-e9a2-4e9e-a47b-087605d7f820 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:14.053842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534c320-efd9-4ba3-9a6e-95d5a1437b79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:14.054314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453e105-e9a2-4e9e-a47b-087605d7f820 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.054754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534c320-efd9-4ba3-9a6e-95d5a1437b79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.056520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453e105-e9a2-4e9e-a47b-087605d7f820 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.058240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534c320-efd9-4ba3-9a6e-95d5a1437b79 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.070019 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 415/829] 10.222.0.79 () {56 vars in 1145 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:14.077648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453e105-e9a2-4e9e-a47b-087605d7f820 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.086499 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 415/830] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:14.093152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534c320-efd9-4ba3-9a6e-95d5a1437b79 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.096245 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453e105-e9a2-4e9e-a47b-087605d7f820 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.106497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534c320-efd9-4ba3-9a6e-95d5a1437b79 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.110224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30859ec1-04bb-4684-a750-a19dc03278bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.110913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30859ec1-04bb-4684-a750-a19dc03278bc admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.111192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30859ec1-04bb-4684-a750-a19dc03278bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.111459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30859ec1-04bb-4684-a750-a19dc03278bc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.112208 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30859ec1-04bb-4684-a750-a19dc03278bc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.113232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-30859ec1-04bb-4684-a750-a19dc03278bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:26:14.113232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:26:14.113232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:26:14.114118 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30859ec1-04bb-4684-a750-a19dc03278bc admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.120201 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f650826-1c30-4827-a547-e58a07179803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.121041 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f650826-1c30-4827-a547-e58a07179803 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.121322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f650826-1c30-4827-a547-e58a07179803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.121590 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f650826-1c30-4827-a547-e58a07179803 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.137303 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f650826-1c30-4827-a547-e58a07179803 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.140032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f650826-1c30-4827-a547-e58a07179803 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.160403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-8f650826-1c30-4827-a547-e58a07179803 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 01:26:14.162530 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 416/831] 10.222.0.79 () {56 vars in 1138 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:14.167861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f650826-1c30-4827-a547-e58a07179803 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.170152 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 416/832] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Feb 21 01:26:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:26:14.186634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f650826-1c30-4827-a547-e58a07179803 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.220540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7310941-8cef-4031-84f3-c3dba793c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.221224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310941-8cef-4031-84f3-c3dba793c58a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.221506 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310941-8cef-4031-84f3-c3dba793c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.221788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310941-8cef-4031-84f3-c3dba793c58a admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.222667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7310941-8cef-4031-84f3-c3dba793c58a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:14.222979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7310941-8cef-4031-84f3-c3dba793c58a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.224852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7310941-8cef-4031-84f3-c3dba793c58a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.254316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 417/833] 10.222.0.79 () {56 vars in 1170 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:14.260126 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30859ec1-04bb-4684-a750-a19dc03278bc admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.275429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30859ec1-04bb-4684-a750-a19dc03278bc admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.282260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9c83d-bc4b-45bc-ada9-bdba5ff23650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.282909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9c83d-bc4b-45bc-ada9-bdba5ff23650 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.283189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9c83d-bc4b-45bc-ada9-bdba5ff23650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.283463 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9c83d-bc4b-45bc-ada9-bdba5ff23650 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.298425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9c83d-bc4b-45bc-ada9-bdba5ff23650 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.300217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9c83d-bc4b-45bc-ada9-bdba5ff23650 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.309378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 417/834] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/auth/tokens => generated 1303 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:14.316077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7310941-8cef-4031-84f3-c3dba793c58a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.335474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7310941-8cef-4031-84f3-c3dba793c58a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.346757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6fe93-8c94-4000-bdd4-6ea422ff5160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.347580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6fe93-8c94-4000-bdd4-6ea422ff5160 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.347866 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6fe93-8c94-4000-bdd4-6ea422ff5160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.348144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6fe93-8c94-4000-bdd4-6ea422ff5160 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.370428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6fe93-8c94-4000-bdd4-6ea422ff5160 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.372280 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6fe93-8c94-4000-bdd4-6ea422ff5160 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.401848 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-a3c6fe93-8c94-4000-bdd4-6ea422ff5160 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:14.404759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 418/835] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:14.409297 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9c83d-bc4b-45bc-ada9-bdba5ff23650 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.421706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9c83d-bc4b-45bc-ada9-bdba5ff23650 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.426088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77c8db-36a2-43c3-8a34-bb45f4f61a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.427833 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77c8db-36a2-43c3-8a34-bb45f4f61a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.428109 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77c8db-36a2-43c3-8a34-bb45f4f61a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.428377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77c8db-36a2-43c3-8a34-bb45f4f61a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.429100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77c8db-36a2-43c3-8a34-bb45f4f61a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:14.429403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77c8db-36a2-43c3-8a34-bb45f4f61a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.431017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77c8db-36a2-43c3-8a34-bb45f4f61a2a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.445309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 418/836] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:14.452206 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6fe93-8c94-4000-bdd4-6ea422ff5160 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.464200 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6fe93-8c94-4000-bdd4-6ea422ff5160 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.471393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210aa29-e47e-40d8-915c-e5a17169bead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.472186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210aa29-e47e-40d8-915c-e5a17169bead admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.472467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210aa29-e47e-40d8-915c-e5a17169bead admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.472742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210aa29-e47e-40d8-915c-e5a17169bead admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.480727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210aa29-e47e-40d8-915c-e5a17169bead admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.483283 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210aa29-e47e-40d8-915c-e5a17169bead admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.496590 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-e210aa29-e47e-40d8-915c-e5a17169bead admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:14.502359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 419/837] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:14.504688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77c8db-36a2-43c3-8a34-bb45f4f61a2a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.515710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77c8db-36a2-43c3-8a34-bb45f4f61a2a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.525875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193956a-8af1-4481-a4d3-65748b70dab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.526565 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193956a-8af1-4481-a4d3-65748b70dab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.526847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193956a-8af1-4481-a4d3-65748b70dab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.527121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193956a-8af1-4481-a4d3-65748b70dab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.527914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193956a-8af1-4481-a4d3-65748b70dab0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:14.528217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193956a-8af1-4481-a4d3-65748b70dab0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.530091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193956a-8af1-4481-a4d3-65748b70dab0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.543576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 419/838] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:14.549856 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210aa29-e47e-40d8-915c-e5a17169bead admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.563557 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210aa29-e47e-40d8-915c-e5a17169bead admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.568452 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd854c51-278f-4187-86f9-2579fb7cf979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.569163 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd854c51-278f-4187-86f9-2579fb7cf979 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.569488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd854c51-278f-4187-86f9-2579fb7cf979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.569807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd854c51-278f-4187-86f9-2579fb7cf979 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.570683 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd854c51-278f-4187-86f9-2579fb7cf979 admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=19893604215b4bd397178347775e0bb2) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:14.572296 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd854c51-278f-4187-86f9-2579fb7cf979 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.573027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd854c51-278f-4187-86f9-2579fb7cf979 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.612036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 420/839] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/role_assignments?user.id=19893604215b4bd397178347775e0bb2&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 608 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:14.640754 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51702d1e-7813-4e6b-860b-f3a60704d6e5 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.641092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51702d1e-7813-4e6b-860b-f3a60704d6e5 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.641301 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51702d1e-7813-4e6b-860b-f3a60704d6e5 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.643340 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 420/840] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:26:14.649138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003fa1-0a55-4734-99ba-aca1b40a9717 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.649452 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003fa1-0a55-4734-99ba-aca1b40a9717 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.649985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003fa1-0a55-4734-99ba-aca1b40a9717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.673054 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-87003fa1-0a55-4734-99ba-aca1b40a9717 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:14.674286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-87003fa1-0a55-4734-99ba-aca1b40a9717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:14.682589 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 421/841] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:14 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:14.717161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51702d1e-7813-4e6b-860b-f3a60704d6e5 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.732129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51702d1e-7813-4e6b-860b-f3a60704d6e5 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.743137 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e22b0-34ca-4f5b-98db-ae1ec6cdf350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.744069 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e22b0-34ca-4f5b-98db-ae1ec6cdf350 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.744357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e22b0-34ca-4f5b-98db-ae1ec6cdf350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.744680 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e22b0-34ca-4f5b-98db-ae1ec6cdf350 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.745356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e22b0-34ca-4f5b-98db-ae1ec6cdf350 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.747205 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e22b0-34ca-4f5b-98db-ae1ec6cdf350 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.760114 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-cb2e22b0-34ca-4f5b-98db-ae1ec6cdf350 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 01:26:14.766413 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 421/842] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:14.767833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87003fa1-0a55-4734-99ba-aca1b40a9717 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.777278 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87003fa1-0a55-4734-99ba-aca1b40a9717 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.786701 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fd9fb-616f-42b9-8741-4694ee387f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.787788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fd9fb-616f-42b9-8741-4694ee387f13 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.788318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fd9fb-616f-42b9-8741-4694ee387f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.788797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fd9fb-616f-42b9-8741-4694ee387f13 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.789775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fd9fb-616f-42b9-8741-4694ee387f13 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:14.790309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fd9fb-616f-42b9-8741-4694ee387f13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.792258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fd9fb-616f-42b9-8741-4694ee387f13 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.802531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 422/843] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:14.808160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e22b0-34ca-4f5b-98db-ae1ec6cdf350 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.830696 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e22b0-34ca-4f5b-98db-ae1ec6cdf350 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.847266 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc520f5-1173-41ef-9302-e992a54b6d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.848346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc520f5-1173-41ef-9302-e992a54b6d73 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.848843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc520f5-1173-41ef-9302-e992a54b6d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.849332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc520f5-1173-41ef-9302-e992a54b6d73 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.850639 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc520f5-1173-41ef-9302-e992a54b6d73 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:14.851189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc520f5-1173-41ef-9302-e992a54b6d73 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.854098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc520f5-1173-41ef-9302-e992a54b6d73 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.866179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 422/844] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:14.871367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fd9fb-616f-42b9-8741-4694ee387f13 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:14.883011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fd9fb-616f-42b9-8741-4694ee387f13 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:14.887692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e03ed6-3a2b-480c-9d48-f8b4de0bc3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:14.888342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e03ed6-3a2b-480c-9d48-f8b4de0bc3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:14.889225 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e03ed6-3a2b-480c-9d48-f8b4de0bc3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:14.889501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e03ed6-3a2b-480c-9d48-f8b4de0bc3b4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:14.890342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e03ed6-3a2b-480c-9d48-f8b4de0bc3b4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:14.891419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-e5e03ed6-3a2b-480c-9d48-f8b4de0bc3b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:26:14.891419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:26:14.891419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:26:14.892299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e03ed6-3a2b-480c-9d48-f8b4de0bc3b4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:14.916857 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 423/845] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Feb 21 01:26:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:26:15.219695 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6137255-144e-4f05-922b-1eb43ad45a35 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.220053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6137255-144e-4f05-922b-1eb43ad45a35 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.220314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6137255-144e-4f05-922b-1eb43ad45a35 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.222399 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 423/846] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:15.230421 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5eb77-12bb-4378-a1d4-d8594ea30eb8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.230722 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5eb77-12bb-4378-a1d4-d8594ea30eb8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.231026 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5eb77-12bb-4378-a1d4-d8594ea30eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.265127 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-acb5eb77-12bb-4378-a1d4-d8594ea30eb8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:15.267641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-acb5eb77-12bb-4378-a1d4-d8594ea30eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:15.295101 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 424/847] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:15 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:15.338304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6137255-144e-4f05-922b-1eb43ad45a35 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.359502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6137255-144e-4f05-922b-1eb43ad45a35 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.367190 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1702ad7-adb6-45c7-ac13-d8d6f07b4df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.368780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1702ad7-adb6-45c7-ac13-d8d6f07b4df6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.369525 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1702ad7-adb6-45c7-ac13-d8d6f07b4df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.370229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1702ad7-adb6-45c7-ac13-d8d6f07b4df6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.382337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6c0aa-a15e-4343-a668-b680378bb97a None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.382755 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6c0aa-a15e-4343-a668-b680378bb97a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.383141 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6c0aa-a15e-4343-a668-b680378bb97a None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.385437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 425/848] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:26:15.390953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7f943-7e76-4ab5-b44f-1d23a01e1265 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.391371 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7f943-7e76-4ab5-b44f-1d23a01e1265 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.391587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7f943-7e76-4ab5-b44f-1d23a01e1265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.393238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1702ad7-adb6-45c7-ac13-d8d6f07b4df6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:15.408005 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-b1702ad7-adb6-45c7-ac13-d8d6f07b4df6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:26:15.410662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4af7f943-7e76-4ab5-b44f-1d23a01e1265 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:15.418332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4af7f943-7e76-4ab5-b44f-1d23a01e1265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:15.418504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 424/849] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:15.420169 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1702ad7-adb6-45c7-ac13-d8d6f07b4df6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.430961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1702ad7-adb6-45c7-ac13-d8d6f07b4df6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.433409 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 426/850] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:15 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:15.440372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f563d-c0ae-4076-99af-26a54ea4f11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.441344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f563d-c0ae-4076-99af-26a54ea4f11a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.441837 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f563d-c0ae-4076-99af-26a54ea4f11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.442390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f563d-c0ae-4076-99af-26a54ea4f11a admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.443367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f563d-c0ae-4076-99af-26a54ea4f11a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:15.443883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f563d-c0ae-4076-99af-26a54ea4f11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.445696 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f563d-c0ae-4076-99af-26a54ea4f11a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.459966 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7f943-7e76-4ab5-b44f-1d23a01e1265 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.460361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 425/851] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:15.461697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f563d-c0ae-4076-99af-26a54ea4f11a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.465289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7f943-7e76-4ab5-b44f-1d23a01e1265 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.470963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6657ef-2ce3-49de-9cf8-0eeef5b40cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.472276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6657ef-2ce3-49de-9cf8-0eeef5b40cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.472662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6657ef-2ce3-49de-9cf8-0eeef5b40cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.473145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6657ef-2ce3-49de-9cf8-0eeef5b40cd6 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.474158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6657ef-2ce3-49de-9cf8-0eeef5b40cd6 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.475848 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6657ef-2ce3-49de-9cf8-0eeef5b40cd6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.476873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f563d-c0ae-4076-99af-26a54ea4f11a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.481605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c1072-9ee3-4412-9f9c-065076c54027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.482711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c1072-9ee3-4412-9f9c-065076c54027 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.483234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c1072-9ee3-4412-9f9c-065076c54027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.483718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c1072-9ee3-4412-9f9c-065076c54027 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.487660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-0d6657ef-2ce3-49de-9cf8-0eeef5b40cd6 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 01:26:15.489117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 427/852] 10.222.0.79 () {56 vars in 1153 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:15.494747 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6657ef-2ce3-49de-9cf8-0eeef5b40cd6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.497718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c1072-9ee3-4412-9f9c-065076c54027 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.500092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c1072-9ee3-4412-9f9c-065076c54027 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.504466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6657ef-2ce3-49de-9cf8-0eeef5b40cd6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.508978 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb4eb1-04ef-4738-84ac-e99ad6a940e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.509917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb4eb1-04ef-4738-84ac-e99ad6a940e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.509917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb4eb1-04ef-4738-84ac-e99ad6a940e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.510237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb4eb1-04ef-4738-84ac-e99ad6a940e4 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.510866 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb4eb1-04ef-4738-84ac-e99ad6a940e4 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:15.511249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb4eb1-04ef-4738-84ac-e99ad6a940e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.512731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb4eb1-04ef-4738-84ac-e99ad6a940e4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.519179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-a66c1072-9ee3-4412-9f9c-065076c54027 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:15.520137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 428/853] 10.222.0.79 () {56 vars in 1147 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:15.525147 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 426/854] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:15.526300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb4eb1-04ef-4738-84ac-e99ad6a940e4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.527098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c1072-9ee3-4412-9f9c-065076c54027 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.539538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c1072-9ee3-4412-9f9c-065076c54027 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.540296 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb4eb1-04ef-4738-84ac-e99ad6a940e4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.544080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb393c2-87ad-42ef-8e82-ddfbfc84edb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.545253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb393c2-87ad-42ef-8e82-ddfbfc84edb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.545487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145fcaf-0c5a-4976-b9e4-9ff0819b7dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.545611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb393c2-87ad-42ef-8e82-ddfbfc84edb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.545829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb393c2-87ad-42ef-8e82-ddfbfc84edb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.546139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145fcaf-0c5a-4976-b9e4-9ff0819b7dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.546512 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145fcaf-0c5a-4976-b9e4-9ff0819b7dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.546612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb393c2-87ad-42ef-8e82-ddfbfc84edb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:15.546807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145fcaf-0c5a-4976-b9e4-9ff0819b7dcb admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.546898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb393c2-87ad-42ef-8e82-ddfbfc84edb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.547593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145fcaf-0c5a-4976-b9e4-9ff0819b7dcb admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:15.547898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145fcaf-0c5a-4976-b9e4-9ff0819b7dcb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.548370 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb393c2-87ad-42ef-8e82-ddfbfc84edb9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.549981 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145fcaf-0c5a-4976-b9e4-9ff0819b7dcb admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.555342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 429/855] 10.222.0.79 () {56 vars in 1147 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:15.564965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 427/856] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:15.570851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145fcaf-0c5a-4976-b9e4-9ff0819b7dcb admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.581102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145fcaf-0c5a-4976-b9e4-9ff0819b7dcb admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.585763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06e661-df5b-460f-93df-b12b96abb2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.586604 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06e661-df5b-460f-93df-b12b96abb2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.586884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06e661-df5b-460f-93df-b12b96abb2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.587157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06e661-df5b-460f-93df-b12b96abb2f5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.596873 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06e661-df5b-460f-93df-b12b96abb2f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.598980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06e661-df5b-460f-93df-b12b96abb2f5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.613955 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-6b06e661-df5b-460f-93df-b12b96abb2f5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 01:26:15.615690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 430/857] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:15.621375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb393c2-87ad-42ef-8e82-ddfbfc84edb9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.636047 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb393c2-87ad-42ef-8e82-ddfbfc84edb9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.641146 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39585fc4-3b88-4fad-88df-85c21750dd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.642128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39585fc4-3b88-4fad-88df-85c21750dd39 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.642641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39585fc4-3b88-4fad-88df-85c21750dd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.643144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39585fc4-3b88-4fad-88df-85c21750dd39 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.644240 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39585fc4-3b88-4fad-88df-85c21750dd39 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:15.644738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39585fc4-3b88-4fad-88df-85c21750dd39 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.646933 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39585fc4-3b88-4fad-88df-85c21750dd39 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.667979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 428/858] 10.222.0.79 () {56 vars in 1156 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:15.675340 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06e661-df5b-460f-93df-b12b96abb2f5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.685393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06e661-df5b-460f-93df-b12b96abb2f5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.690333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3e5c8-ef38-472f-9bc2-1f66f17a70ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.691047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3e5c8-ef38-472f-9bc2-1f66f17a70ff admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.691331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3e5c8-ef38-472f-9bc2-1f66f17a70ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.691706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3e5c8-ef38-472f-9bc2-1f66f17a70ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.700638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3e5c8-ef38-472f-9bc2-1f66f17a70ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.702565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3e5c8-ef38-472f-9bc2-1f66f17a70ff admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.718105 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 431/859] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:15.719519 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39585fc4-3b88-4fad-88df-85c21750dd39 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.731845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39585fc4-3b88-4fad-88df-85c21750dd39 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.737827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1da07-7397-4761-b4dd-459612b41f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.739067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1da07-7397-4761-b4dd-459612b41f54 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.739658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1da07-7397-4761-b4dd-459612b41f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.740147 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1da07-7397-4761-b4dd-459612b41f54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.752377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1da07-7397-4761-b4dd-459612b41f54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.754663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1da07-7397-4761-b4dd-459612b41f54 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.772908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-3da1da07-7397-4761-b4dd-459612b41f54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:15.774408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 429/860] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:15.780986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3e5c8-ef38-472f-9bc2-1f66f17a70ff admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.791300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3e5c8-ef38-472f-9bc2-1f66f17a70ff admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.796558 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a40fb-6d4e-4f69-9642-0953605eab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.797374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a40fb-6d4e-4f69-9642-0953605eab89 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.797765 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a40fb-6d4e-4f69-9642-0953605eab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.798148 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a40fb-6d4e-4f69-9642-0953605eab89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.799075 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a40fb-6d4e-4f69-9642-0953605eab89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:15.799528 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a40fb-6d4e-4f69-9642-0953605eab89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.801229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a40fb-6d4e-4f69-9642-0953605eab89 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.816989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 432/861] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:15.822673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1da07-7397-4761-b4dd-459612b41f54 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.833611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1da07-7397-4761-b4dd-459612b41f54 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.838905 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc6671-0cd7-47ec-af8f-1220e4327480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.839861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc6671-0cd7-47ec-af8f-1220e4327480 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.840292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc6671-0cd7-47ec-af8f-1220e4327480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.840810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc6671-0cd7-47ec-af8f-1220e4327480 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.848357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc6671-0cd7-47ec-af8f-1220e4327480 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.850508 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc6671-0cd7-47ec-af8f-1220e4327480 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.864054 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-abcc6671-0cd7-47ec-af8f-1220e4327480 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:15.868550 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 430/862] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:15.871488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a40fb-6d4e-4f69-9642-0953605eab89 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.882755 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a40fb-6d4e-4f69-9642-0953605eab89 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.887808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670a38a-401f-4415-8459-dc8ade7d54c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.889324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670a38a-401f-4415-8459-dc8ade7d54c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.889748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670a38a-401f-4415-8459-dc8ade7d54c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.890238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670a38a-401f-4415-8459-dc8ade7d54c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.891200 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670a38a-401f-4415-8459-dc8ade7d54c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:15.891649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670a38a-401f-4415-8459-dc8ade7d54c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.893653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670a38a-401f-4415-8459-dc8ade7d54c0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.906304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 433/863] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:15.915449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc6671-0cd7-47ec-af8f-1220e4327480 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:15.925881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc6671-0cd7-47ec-af8f-1220e4327480 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:15.930597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb79f0-0dbe-4771-aa06-47133c749a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:15.931224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb79f0-0dbe-4771-aa06-47133c749a3f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:15.931547 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb79f0-0dbe-4771-aa06-47133c749a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:15.931822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb79f0-0dbe-4771-aa06-47133c749a3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:15.932642 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb79f0-0dbe-4771-aa06-47133c749a3f admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=0cb0a0d56f0049b19ba22e0dd041897e) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:15.932995 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb79f0-0dbe-4771-aa06-47133c749a3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:15.934899 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb79f0-0dbe-4771-aa06-47133c749a3f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:15.941688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 431/864] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:15 2022] GET /identity/v3/role_assignments?user.id=0cb0a0d56f0049b19ba22e0dd041897e&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=548abad662724741a3261205ee7cb828 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:17.062343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089f99b-0922-4a55-bc77-8009dbc0a458 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.062860 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089f99b-0922-4a55-bc77-8009dbc0a458 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.062936 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089f99b-0922-4a55-bc77-8009dbc0a458 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.065016 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 434/865] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:26:17.070610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab342ee-d576-4056-8c4c-60ed0a554143 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.071105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab342ee-d576-4056-8c4c-60ed0a554143 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.071183 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab342ee-d576-4056-8c4c-60ed0a554143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.089242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-6ab342ee-d576-4056-8c4c-60ed0a554143 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:17.090435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6ab342ee-d576-4056-8c4c-60ed0a554143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:17.098939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 432/866] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:17 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:17.121794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089f99b-0922-4a55-bc77-8009dbc0a458 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.135024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089f99b-0922-4a55-bc77-8009dbc0a458 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.139415 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d42d4-421e-4a23-97bd-1e0d93cba530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.140198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d42d4-421e-4a23-97bd-1e0d93cba530 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.140477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d42d4-421e-4a23-97bd-1e0d93cba530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.140748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d42d4-421e-4a23-97bd-1e0d93cba530 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.141400 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d42d4-421e-4a23-97bd-1e0d93cba530 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.143020 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d42d4-421e-4a23-97bd-1e0d93cba530 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.154798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-929d42d4-421e-4a23-97bd-1e0d93cba530 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 01:26:17.156251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 435/867] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:17.161933 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab342ee-d576-4056-8c4c-60ed0a554143 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.171427 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab342ee-d576-4056-8c4c-60ed0a554143 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.175984 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3543007-4f8a-4b3d-bd5d-2d19a0b49ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.176644 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543007-4f8a-4b3d-bd5d-2d19a0b49ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.176920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543007-4f8a-4b3d-bd5d-2d19a0b49ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.177193 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543007-4f8a-4b3d-bd5d-2d19a0b49ef6 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.177896 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3543007-4f8a-4b3d-bd5d-2d19a0b49ef6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:17.178215 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3543007-4f8a-4b3d-bd5d-2d19a0b49ef6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.179822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3543007-4f8a-4b3d-bd5d-2d19a0b49ef6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.184762 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 433/868] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:17.190800 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d42d4-421e-4a23-97bd-1e0d93cba530 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.200338 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d42d4-421e-4a23-97bd-1e0d93cba530 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.205321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99636b1c-5363-46c6-916c-c1009a152b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.205969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99636b1c-5363-46c6-916c-c1009a152b4e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.206277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99636b1c-5363-46c6-916c-c1009a152b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.206552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99636b1c-5363-46c6-916c-c1009a152b4e admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.207252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99636b1c-5363-46c6-916c-c1009a152b4e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:17.207550 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99636b1c-5363-46c6-916c-c1009a152b4e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.209134 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99636b1c-5363-46c6-916c-c1009a152b4e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.213925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 436/869] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:17.424654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae13d31-7907-43e4-b38f-60bb89957400 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.424980 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae13d31-7907-43e4-b38f-60bb89957400 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.425209 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae13d31-7907-43e4-b38f-60bb89957400 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.427270 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 434/870] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:17.432638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cafdcb-02e9-4982-8c20-8917bd26625d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.432926 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cafdcb-02e9-4982-8c20-8917bd26625d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.433201 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cafdcb-02e9-4982-8c20-8917bd26625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.451112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-17cafdcb-02e9-4982-8c20-8917bd26625d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:17.452276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-17cafdcb-02e9-4982-8c20-8917bd26625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:17.460488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 437/871] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:17 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:17.485885 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae13d31-7907-43e4-b38f-60bb89957400 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.497637 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae13d31-7907-43e4-b38f-60bb89957400 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.502329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e50bb4-7885-4295-be32-1757fe5bdef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.503127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e50bb4-7885-4295-be32-1757fe5bdef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.503404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e50bb4-7885-4295-be32-1757fe5bdef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.503672 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e50bb4-7885-4295-be32-1757fe5bdef7 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.514538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e50bb4-7885-4295-be32-1757fe5bdef7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:17.521696 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-f4e50bb4-7885-4295-be32-1757fe5bdef7 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 01:26:17.523197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 435/872] 10.222.0.79 () {56 vars in 1141 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:17.528902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cafdcb-02e9-4982-8c20-8917bd26625d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.538325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cafdcb-02e9-4982-8c20-8917bd26625d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.542796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64452085-9d05-4b34-ae12-4d21a0684013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.543453 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64452085-9d05-4b34-ae12-4d21a0684013 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.543728 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64452085-9d05-4b34-ae12-4d21a0684013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.543998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64452085-9d05-4b34-ae12-4d21a0684013 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.544768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64452085-9d05-4b34-ae12-4d21a0684013 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:17.545069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64452085-9d05-4b34-ae12-4d21a0684013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.546677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64452085-9d05-4b34-ae12-4d21a0684013 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.555403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 438/873] 10.222.0.79 () {56 vars in 1136 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:17.560825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e50bb4-7885-4295-be32-1757fe5bdef7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.571177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e50bb4-7885-4295-be32-1757fe5bdef7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.575708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144526f0-7052-4d21-b674-c6a5471e4849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.577078 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144526f0-7052-4d21-b674-c6a5471e4849 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.577362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144526f0-7052-4d21-b674-c6a5471e4849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.577629 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144526f0-7052-4d21-b674-c6a5471e4849 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.589239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144526f0-7052-4d21-b674-c6a5471e4849 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.591170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144526f0-7052-4d21-b674-c6a5471e4849 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.613601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-144526f0-7052-4d21-b674-c6a5471e4849 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:17.615342 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 436/874] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:17.620836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64452085-9d05-4b34-ae12-4d21a0684013 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.630798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64452085-9d05-4b34-ae12-4d21a0684013 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.635298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80d9d7-b767-4531-8732-820ee3938fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.635948 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80d9d7-b767-4531-8732-820ee3938fac admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.636226 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80d9d7-b767-4531-8732-820ee3938fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.636493 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80d9d7-b767-4531-8732-820ee3938fac admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.637206 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80d9d7-b767-4531-8732-820ee3938fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:17.637506 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80d9d7-b767-4531-8732-820ee3938fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.639676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80d9d7-b767-4531-8732-820ee3938fac admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.657118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 439/875] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:17.662330 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144526f0-7052-4d21-b674-c6a5471e4849 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.671935 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144526f0-7052-4d21-b674-c6a5471e4849 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.676471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f5372-2619-408e-a965-af7aeec7b857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.677247 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f5372-2619-408e-a965-af7aeec7b857 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.677527 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f5372-2619-408e-a965-af7aeec7b857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.677797 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f5372-2619-408e-a965-af7aeec7b857 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.684952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f5372-2619-408e-a965-af7aeec7b857 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.687023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f5372-2619-408e-a965-af7aeec7b857 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.701593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-060f5372-2619-408e-a965-af7aeec7b857 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 01:26:17.703110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 437/876] 10.222.0.79 () {56 vars in 1138 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:17.708744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80d9d7-b767-4531-8732-820ee3938fac admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.719120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80d9d7-b767-4531-8732-820ee3938fac admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.723743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84742aa-4bb4-405b-a756-8b5ee184a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.724390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84742aa-4bb4-405b-a756-8b5ee184a2cb admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.724708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84742aa-4bb4-405b-a756-8b5ee184a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.724983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84742aa-4bb4-405b-a756-8b5ee184a2cb admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.725812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84742aa-4bb4-405b-a756-8b5ee184a2cb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:17.726231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84742aa-4bb4-405b-a756-8b5ee184a2cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.728165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84742aa-4bb4-405b-a756-8b5ee184a2cb admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.745807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 440/877] 10.222.0.79 () {56 vars in 1170 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:17.751677 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f5372-2619-408e-a965-af7aeec7b857 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.762573 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f5372-2619-408e-a965-af7aeec7b857 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.767708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43930f-0216-471c-9ab1-7914e030d0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.768335 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43930f-0216-471c-9ab1-7914e030d0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.768665 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43930f-0216-471c-9ab1-7914e030d0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.768940 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43930f-0216-471c-9ab1-7914e030d0d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.776961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43930f-0216-471c-9ab1-7914e030d0d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.778781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43930f-0216-471c-9ab1-7914e030d0d5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.788448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 438/878] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:17.793933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84742aa-4bb4-405b-a756-8b5ee184a2cb admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.803882 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84742aa-4bb4-405b-a756-8b5ee184a2cb admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.808616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7cc2e-07e0-4b78-8cf1-2dcb9910f2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.809437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7cc2e-07e0-4b78-8cf1-2dcb9910f2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.809719 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7cc2e-07e0-4b78-8cf1-2dcb9910f2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.810011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7cc2e-07e0-4b78-8cf1-2dcb9910f2a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.820565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7cc2e-07e0-4b78-8cf1-2dcb9910f2a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.822452 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7cc2e-07e0-4b78-8cf1-2dcb9910f2a6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.839568 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-84f7cc2e-07e0-4b78-8cf1-2dcb9910f2a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:17.841027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 441/879] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:17.847037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43930f-0216-471c-9ab1-7914e030d0d5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.856033 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43930f-0216-471c-9ab1-7914e030d0d5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.860944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137ae44-04bf-4f36-8ffa-d028e6537c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.861585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137ae44-04bf-4f36-8ffa-d028e6537c63 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.861916 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137ae44-04bf-4f36-8ffa-d028e6537c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.862185 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137ae44-04bf-4f36-8ffa-d028e6537c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.862978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137ae44-04bf-4f36-8ffa-d028e6537c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:17.863285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137ae44-04bf-4f36-8ffa-d028e6537c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.864897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137ae44-04bf-4f36-8ffa-d028e6537c63 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.877710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 439/880] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:17.883116 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7cc2e-07e0-4b78-8cf1-2dcb9910f2a6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.893470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7cc2e-07e0-4b78-8cf1-2dcb9910f2a6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.898258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5417ec1-d8b6-41e6-98d9-7d918b97da4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.899044 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5417ec1-d8b6-41e6-98d9-7d918b97da4f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.899373 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5417ec1-d8b6-41e6-98d9-7d918b97da4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.899644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5417ec1-d8b6-41e6-98d9-7d918b97da4f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.907503 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5417ec1-d8b6-41e6-98d9-7d918b97da4f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.909549 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5417ec1-d8b6-41e6-98d9-7d918b97da4f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.923674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-d5417ec1-d8b6-41e6-98d9-7d918b97da4f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:17.925165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 442/881] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:17.930878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137ae44-04bf-4f36-8ffa-d028e6537c63 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.940800 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137ae44-04bf-4f36-8ffa-d028e6537c63 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.945584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff6afc-23d4-4114-94cb-11e99f77bff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.946325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff6afc-23d4-4114-94cb-11e99f77bff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.946608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff6afc-23d4-4114-94cb-11e99f77bff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.946878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff6afc-23d4-4114-94cb-11e99f77bff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.947712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff6afc-23d4-4114-94cb-11e99f77bff9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:17.948017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff6afc-23d4-4114-94cb-11e99f77bff9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.949971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff6afc-23d4-4114-94cb-11e99f77bff9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:17.964031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 440/882] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:17.970312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5417ec1-d8b6-41e6-98d9-7d918b97da4f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:17.981419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5417ec1-d8b6-41e6-98d9-7d918b97da4f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:17.981684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348267-303b-4525-910b-d76f33891a51 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.981852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348267-303b-4525-910b-d76f33891a51 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.982716 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348267-303b-4525-910b-d76f33891a51 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.985067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 441/883] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:17.987897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2c6e0-b707-4dd8-ba72-24d35999294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:17.988547 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2c6e0-b707-4dd8-ba72-24d35999294f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.988953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2c6e0-b707-4dd8-ba72-24d35999294f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.989235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2c6e0-b707-4dd8-ba72-24d35999294f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.990091 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2c6e0-b707-4dd8-ba72-24d35999294f admin admin] RBAC: Adding query filter params (role.id=e0a1a99f5c794f5db82f71def072c7c9, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=19893604215b4bd397178347775e0bb2) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:17.991388 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e08ac-0250-4d50-88c6-44435a250d31 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:17.991669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e08ac-0250-4d50-88c6-44435a250d31 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:17.991939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e08ac-0250-4d50-88c6-44435a250d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:17.993404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2c6e0-b707-4dd8-ba72-24d35999294f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:17.995514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2c6e0-b707-4dd8-ba72-24d35999294f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:18.003968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 443/884] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:17 2022] GET /identity/v3/role_assignments?user.id=19893604215b4bd397178347775e0bb2&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=e0a1a99f5c794f5db82f71def072c7c9 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:18.017684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-d13e08ac-0250-4d50-88c6-44435a250d31 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:18.019319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-d13e08ac-0250-4d50-88c6-44435a250d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:18.028381 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 442/885] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:17 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:18.053673 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2c6e0-b707-4dd8-ba72-24d35999294f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:18.065016 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2c6e0-b707-4dd8-ba72-24d35999294f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:18.069780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ad2b3-f8d4-4502-9f84-a952bafdcc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:18.070504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ad2b3-f8d4-4502-9f84-a952bafdcc55 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:18.070789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ad2b3-f8d4-4502-9f84-a952bafdcc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:18.071062 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ad2b3-f8d4-4502-9f84-a952bafdcc55 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:18.071830 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ad2b3-f8d4-4502-9f84-a952bafdcc55 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:18.073468 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ad2b3-f8d4-4502-9f84-a952bafdcc55 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:18.098419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 444/886] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:26:18 2022] POST /identity/v3/services => generated 269 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:18.395921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0af424-68ba-424e-9d9d-027c3bc793b5 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:18.396879 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0af424-68ba-424e-9d9d-027c3bc793b5 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:18.397160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0af424-68ba-424e-9d9d-027c3bc793b5 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:18.399207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 443/887] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:18.405285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf96ed-6235-4f4a-ad68-6e0bbde982c5 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:18.405845 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf96ed-6235-4f4a-ad68-6e0bbde982c5 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:18.406384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf96ed-6235-4f4a-ad68-6e0bbde982c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:18.425141 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-5cdf96ed-6235-4f4a-ad68-6e0bbde982c5 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:18.426776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5cdf96ed-6235-4f4a-ad68-6e0bbde982c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:18.450328 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 445/888] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:18 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:18.467939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0af424-68ba-424e-9d9d-027c3bc793b5 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:18.480752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0af424-68ba-424e-9d9d-027c3bc793b5 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:18.485671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b8d6f-48d9-40f7-8fdd-8566cd4000c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:18.486771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b8d6f-48d9-40f7-8fdd-8566cd4000c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:18.487288 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b8d6f-48d9-40f7-8fdd-8566cd4000c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:18.487850 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b8d6f-48d9-40f7-8fdd-8566cd4000c0 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:18.488711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b8d6f-48d9-40f7-8fdd-8566cd4000c0 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:18.490615 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b8d6f-48d9-40f7-8fdd-8566cd4000c0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:18.503006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-8c6b8d6f-48d9-40f7-8fdd-8566cd4000c0 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 01:26:18.509405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 444/889] 10.222.0.79 () {56 vars in 1147 bytes} [Mon Feb 21 01:26:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:18.510987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf96ed-6235-4f4a-ad68-6e0bbde982c5 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:18.520988 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf96ed-6235-4f4a-ad68-6e0bbde982c5 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:18.525927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac0de1-7017-4189-8fdb-8bd5b04480a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:18.526923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac0de1-7017-4189-8fdb-8bd5b04480a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:18.527433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac0de1-7017-4189-8fdb-8bd5b04480a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:18.527937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac0de1-7017-4189-8fdb-8bd5b04480a5 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:18.528904 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac0de1-7017-4189-8fdb-8bd5b04480a5 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:18.530052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac0de1-7017-4189-8fdb-8bd5b04480a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:18.531904 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac0de1-7017-4189-8fdb-8bd5b04480a5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:18.541553 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 446/890] 10.222.0.79 () {56 vars in 1143 bytes} [Mon Feb 21 01:26:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:18.543096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b8d6f-48d9-40f7-8fdd-8566cd4000c0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:18.553486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b8d6f-48d9-40f7-8fdd-8566cd4000c0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:18.558441 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd2fa7-89a9-4005-b196-06ff9b2fb375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:18.559441 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd2fa7-89a9-4005-b196-06ff9b2fb375 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:18.559935 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd2fa7-89a9-4005-b196-06ff9b2fb375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:18.560528 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd2fa7-89a9-4005-b196-06ff9b2fb375 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:18.561447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd2fa7-89a9-4005-b196-06ff9b2fb375 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:18.562051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd2fa7-89a9-4005-b196-06ff9b2fb375 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:18.563970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd2fa7-89a9-4005-b196-06ff9b2fb375 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:18.574386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 445/891] 10.222.0.79 () {56 vars in 1143 bytes} [Mon Feb 21 01:26:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:19.614745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714f030-3e7e-48a4-a083-11ead905a27e None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:19.615260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714f030-3e7e-48a4-a083-11ead905a27e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:19.615260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714f030-3e7e-48a4-a083-11ead905a27e None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:19.617258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 447/892] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:19.623293 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300326e-52ec-4772-a8ab-c947e0c980c6 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:19.623706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300326e-52ec-4772-a8ab-c947e0c980c6 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:19.623913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300326e-52ec-4772-a8ab-c947e0c980c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:19.642568 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-8300326e-52ec-4772-a8ab-c947e0c980c6 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:19.643735 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8300326e-52ec-4772-a8ab-c947e0c980c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:19.656011 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 446/893] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:19 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:19.678396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714f030-3e7e-48a4-a083-11ead905a27e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:19.691278 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714f030-3e7e-48a4-a083-11ead905a27e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:19.695711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802824e-a5d5-4194-8321-9ac681fa3a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:19.696364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802824e-a5d5-4194-8321-9ac681fa3a47 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:19.696690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802824e-a5d5-4194-8321-9ac681fa3a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:19.696958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802824e-a5d5-4194-8321-9ac681fa3a47 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:19.697728 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802824e-a5d5-4194-8321-9ac681fa3a47 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:19.699438 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802824e-a5d5-4194-8321-9ac681fa3a47 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:19.715953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 448/894] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:26:19 2022] POST /identity/v3/services => generated 251 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:20.327159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce56ee3-3172-4183-90d7-f8278f395252 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.327862 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce56ee3-3172-4183-90d7-f8278f395252 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.328350 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce56ee3-3172-4183-90d7-f8278f395252 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.330609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 447/895] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:20.335941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fe6c2-05aa-471c-a26b-384689606c91 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.336473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fe6c2-05aa-471c-a26b-384689606c91 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.336951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fe6c2-05aa-471c-a26b-384689606c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.354940 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-524fe6c2-05aa-471c-a26b-384689606c91 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:20.356407 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-524fe6c2-05aa-471c-a26b-384689606c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:20.374368 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 449/896] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:20 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:20.398118 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce56ee3-3172-4183-90d7-f8278f395252 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.410836 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce56ee3-3172-4183-90d7-f8278f395252 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.415648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d286c-7e52-44e6-bf70-0328353d1264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.416672 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d286c-7e52-44e6-bf70-0328353d1264 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.417154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d286c-7e52-44e6-bf70-0328353d1264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.417649 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d286c-7e52-44e6-bf70-0328353d1264 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.428750 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d286c-7e52-44e6-bf70-0328353d1264 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:20.436936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-9f5d286c-7e52-44e6-bf70-0328353d1264 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 01:26:20.438689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 448/897] 10.222.0.79 () {56 vars in 1141 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:20.444657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fe6c2-05aa-471c-a26b-384689606c91 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.454039 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e94aa0-cbe6-4aad-b31e-0aadb1cc6cba None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.454364 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e94aa0-cbe6-4aad-b31e-0aadb1cc6cba None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.454645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e94aa0-cbe6-4aad-b31e-0aadb1cc6cba None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.455171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fe6c2-05aa-471c-a26b-384689606c91 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.456942 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 449/898] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:20.460354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29132568-eacf-40a1-8054-51291dfafcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.461271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29132568-eacf-40a1-8054-51291dfafcdd admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.461772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29132568-eacf-40a1-8054-51291dfafcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.462021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246be12-e650-4d42-8c82-15f170488c69 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.462349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246be12-e650-4d42-8c82-15f170488c69 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.462630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246be12-e650-4d42-8c82-15f170488c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.462902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29132568-eacf-40a1-8054-51291dfafcdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.463920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29132568-eacf-40a1-8054-51291dfafcdd admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:20.464321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29132568-eacf-40a1-8054-51291dfafcdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.466129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29132568-eacf-40a1-8054-51291dfafcdd admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.475412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 450/899] 10.222.0.79 () {56 vars in 1136 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:20.481471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29132568-eacf-40a1-8054-51291dfafcdd admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.481703 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-3246be12-e650-4d42-8c82-15f170488c69 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:20.483501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3246be12-e650-4d42-8c82-15f170488c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:20.491579 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 450/900] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:20 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:20.492880 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29132568-eacf-40a1-8054-51291dfafcdd admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.502690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3fbcd-e2e6-45e6-8232-6a0f844f340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.502690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3fbcd-e2e6-45e6-8232-6a0f844f340e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.502690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3fbcd-e2e6-45e6-8232-6a0f844f340e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.502690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3fbcd-e2e6-45e6-8232-6a0f844f340e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.512321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3fbcd-e2e6-45e6-8232-6a0f844f340e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.514488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3fbcd-e2e6-45e6-8232-6a0f844f340e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.515051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246be12-e650-4d42-8c82-15f170488c69 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.523992 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246be12-e650-4d42-8c82-15f170488c69 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.528557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d353c1e-4446-4b17-9e12-737774ca35a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.529393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d353c1e-4446-4b17-9e12-737774ca35a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.529674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d353c1e-4446-4b17-9e12-737774ca35a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.529946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d353c1e-4446-4b17-9e12-737774ca35a3 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.530683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d353c1e-4446-4b17-9e12-737774ca35a3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.532283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d353c1e-4446-4b17-9e12-737774ca35a3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.533699 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-c9f3fbcd-e2e6-45e6-8232-6a0f844f340e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:20.535528 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 451/901] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:20.543330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3fbcd-e2e6-45e6-8232-6a0f844f340e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.544247 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-6d353c1e-4446-4b17-9e12-737774ca35a3 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 01:26:20.550434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 451/902] 10.222.0.79 () {56 vars in 1153 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:20.552234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d353c1e-4446-4b17-9e12-737774ca35a3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.554904 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3fbcd-e2e6-45e6-8232-6a0f844f340e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.560806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87695a-29ec-4f48-bfd4-a22fddd3af1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.561911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87695a-29ec-4f48-bfd4-a22fddd3af1d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.562441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87695a-29ec-4f48-bfd4-a22fddd3af1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.562938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87695a-29ec-4f48-bfd4-a22fddd3af1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.563932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87695a-29ec-4f48-bfd4-a22fddd3af1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:20.564044 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d353c1e-4446-4b17-9e12-737774ca35a3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.564724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87695a-29ec-4f48-bfd4-a22fddd3af1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.567151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87695a-29ec-4f48-bfd4-a22fddd3af1d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.568867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05550a3-f50f-4ecd-bc58-b32c574a83f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.569546 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05550a3-f50f-4ecd-bc58-b32c574a83f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.569825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05550a3-f50f-4ecd-bc58-b32c574a83f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.570097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05550a3-f50f-4ecd-bc58-b32c574a83f7 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.570913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05550a3-f50f-4ecd-bc58-b32c574a83f7 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:20.571166 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05550a3-f50f-4ecd-bc58-b32c574a83f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.573013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05550a3-f50f-4ecd-bc58-b32c574a83f7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.583938 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 452/903] 10.222.0.79 () {56 vars in 1147 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:20.584903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05550a3-f50f-4ecd-bc58-b32c574a83f7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.586540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 452/904] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:20.592272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87695a-29ec-4f48-bfd4-a22fddd3af1d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.595159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05550a3-f50f-4ecd-bc58-b32c574a83f7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.599679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8426f6-00ef-4f41-ab86-4db962049480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.600320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8426f6-00ef-4f41-ab86-4db962049480 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.600604 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8426f6-00ef-4f41-ab86-4db962049480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.600874 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8426f6-00ef-4f41-ab86-4db962049480 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.601574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8426f6-00ef-4f41-ab86-4db962049480 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:20.601875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8426f6-00ef-4f41-ab86-4db962049480 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.603505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8426f6-00ef-4f41-ab86-4db962049480 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.604816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87695a-29ec-4f48-bfd4-a22fddd3af1d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.610390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696fcfe-6cfd-4d60-8f41-78f22a2287c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.611548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696fcfe-6cfd-4d60-8f41-78f22a2287c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.612091 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696fcfe-6cfd-4d60-8f41-78f22a2287c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.612562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696fcfe-6cfd-4d60-8f41-78f22a2287c9 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.614390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 453/905] 10.222.0.79 () {56 vars in 1147 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:20.615247 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8426f6-00ef-4f41-ab86-4db962049480 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.621249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696fcfe-6cfd-4d60-8f41-78f22a2287c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.624748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696fcfe-6cfd-4d60-8f41-78f22a2287c9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.625565 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8426f6-00ef-4f41-ab86-4db962049480 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.630006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bccc2-09f5-4e0e-a7ec-19e4fc7d132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.630683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bccc2-09f5-4e0e-a7ec-19e4fc7d132d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.630959 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bccc2-09f5-4e0e-a7ec-19e4fc7d132d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.631233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bccc2-09f5-4e0e-a7ec-19e4fc7d132d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.632026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bccc2-09f5-4e0e-a7ec-19e4fc7d132d admin admin] RBAC: Adding query filter params (interface=public, service_id=5491e6c24ef14a89a55840973080bd74, region_id=RegionOne) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:20.632325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bccc2-09f5-4e0e-a7ec-19e4fc7d132d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.633899 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bccc2-09f5-4e0e-a7ec-19e4fc7d132d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.643193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-8696fcfe-6cfd-4d60-8f41-78f22a2287c9 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 01:26:20.644406 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 454/906] 10.222.0.79 () {56 vars in 1272 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/endpoints?service_id=5491e6c24ef14a89a55840973080bd74&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:20.645138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 453/907] 10.222.0.79 () {56 vars in 1138 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:20.645255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bccc2-09f5-4e0e-a7ec-19e4fc7d132d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.650617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696fcfe-6cfd-4d60-8f41-78f22a2287c9 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.660008 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bccc2-09f5-4e0e-a7ec-19e4fc7d132d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.661237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696fcfe-6cfd-4d60-8f41-78f22a2287c9 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.666141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4b879-a545-4c19-850b-8f92db4e06f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.666570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5e19d-3a8c-48e8-b76f-61828696de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.667053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4b879-a545-4c19-850b-8f92db4e06f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.667408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4b879-a545-4c19-850b-8f92db4e06f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.667768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e19d-3a8c-48e8-b76f-61828696de9a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.667869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4b879-a545-4c19-850b-8f92db4e06f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.668308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e19d-3a8c-48e8-b76f-61828696de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.668628 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4b879-a545-4c19-850b-8f92db4e06f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.668936 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e19d-3a8c-48e8-b76f-61828696de9a admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.669966 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5e19d-3a8c-48e8-b76f-61828696de9a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:20.670482 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5e19d-3a8c-48e8-b76f-61828696de9a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.670602 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4b879-a545-4c19-850b-8f92db4e06f8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.672587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5e19d-3a8c-48e8-b76f-61828696de9a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.682347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 455/908] 10.222.0.79 () {56 vars in 1108 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/services => generated 1268 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:26:20.693190 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 454/909] 10.222.0.79 () {56 vars in 1170 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:20.700181 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4b879-a545-4c19-850b-8f92db4e06f8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.711585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4b879-a545-4c19-850b-8f92db4e06f8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.717257 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae56315-a93f-44dd-9225-808590e9e6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.718425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae56315-a93f-44dd-9225-808590e9e6fd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.718929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae56315-a93f-44dd-9225-808590e9e6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.719370 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae56315-a93f-44dd-9225-808590e9e6fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.731425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae56315-a93f-44dd-9225-808590e9e6fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.733638 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae56315-a93f-44dd-9225-808590e9e6fd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.752064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-dae56315-a93f-44dd-9225-808590e9e6fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:20.753927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 456/910] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:20.759821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5e19d-3a8c-48e8-b76f-61828696de9a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.771084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5e19d-3a8c-48e8-b76f-61828696de9a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.776227 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff988a0-463a-4383-af2a-68687cc31ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.777235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff988a0-463a-4383-af2a-68687cc31ccc admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.777695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff988a0-463a-4383-af2a-68687cc31ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.778142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff988a0-463a-4383-af2a-68687cc31ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.779775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff988a0-463a-4383-af2a-68687cc31ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:20.780274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff988a0-463a-4383-af2a-68687cc31ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.782129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff988a0-463a-4383-af2a-68687cc31ccc admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.796221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 455/911] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:20.802112 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae56315-a93f-44dd-9225-808590e9e6fd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.816483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae56315-a93f-44dd-9225-808590e9e6fd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.821389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e42d4a-6210-4547-9a9c-ce1db5c20522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.822412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e42d4a-6210-4547-9a9c-ce1db5c20522 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.822768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e42d4a-6210-4547-9a9c-ce1db5c20522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.823162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e42d4a-6210-4547-9a9c-ce1db5c20522 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.831554 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e42d4a-6210-4547-9a9c-ce1db5c20522 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.833715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e42d4a-6210-4547-9a9c-ce1db5c20522 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.849063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-38e42d4a-6210-4547-9a9c-ce1db5c20522 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:20.850665 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 457/912] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:20.859688 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff988a0-463a-4383-af2a-68687cc31ccc admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.871660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff988a0-463a-4383-af2a-68687cc31ccc admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.877531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6aba7-908b-4b87-a99a-c1ffba90341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.878195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6aba7-908b-4b87-a99a-c1ffba90341b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.878511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6aba7-908b-4b87-a99a-c1ffba90341b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.878785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6aba7-908b-4b87-a99a-c1ffba90341b admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.879573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6aba7-908b-4b87-a99a-c1ffba90341b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:20.879877 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6aba7-908b-4b87-a99a-c1ffba90341b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.881706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6aba7-908b-4b87-a99a-c1ffba90341b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.895044 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 456/913] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:20.900856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e42d4a-6210-4547-9a9c-ce1db5c20522 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:20.911508 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e42d4a-6210-4547-9a9c-ce1db5c20522 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:20.916126 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed1332-6a58-4ab6-8c61-310eee3e72f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:20.917050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed1332-6a58-4ab6-8c61-310eee3e72f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.917326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed1332-6a58-4ab6-8c61-310eee3e72f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.917643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed1332-6a58-4ab6-8c61-310eee3e72f7 admin admin] PATH_INFO: `/v3/projects/0eaab085a52a4171be0afec37707daca/users/19893604215b4bd397178347775e0bb2/roles/e0a1a99f5c794f5db82f71def072c7c9` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.920515 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed1332-6a58-4ab6-8c61-310eee3e72f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaab085a52a4171be0afec37707daca, user_id=19893604215b4bd397178347775e0bb2, role_id=e0a1a99f5c794f5db82f71def072c7c9)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:20.923468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed1332-6a58-4ab6-8c61-310eee3e72f7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:20.940084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 458/914] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:26:20 2022] PUT /identity/v3/projects/0eaab085a52a4171be0afec37707daca/users/19893604215b4bd397178347775e0bb2/roles/e0a1a99f5c794f5db82f71def072c7c9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:26:20.955795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eb59d-42c9-4eea-a273-53c4e4f1d6cc None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.956242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eb59d-42c9-4eea-a273-53c4e4f1d6cc None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.956629 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eb59d-42c9-4eea-a273-53c4e4f1d6cc None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.958994 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 457/915] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:20.966995 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8deb7-c86d-4928-9261-6ac74f3c6fa8 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:20.966995 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8deb7-c86d-4928-9261-6ac74f3c6fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:20.966995 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8deb7-c86d-4928-9261-6ac74f3c6fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:20.985467 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-4ac8deb7-c86d-4928-9261-6ac74f3c6fa8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:20.987014 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-4ac8deb7-c86d-4928-9261-6ac74f3c6fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:21.052966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 459/916] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:20 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:21.073355 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803eb59d-42c9-4eea-a273-53c4e4f1d6cc None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:21.087441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803eb59d-42c9-4eea-a273-53c4e4f1d6cc None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:21.110250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955efada-b803-426f-b8eb-14b4e503825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:21.110250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955efada-b803-426f-b8eb-14b4e503825e admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:21.110250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955efada-b803-426f-b8eb-14b4e503825e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:21.110250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955efada-b803-426f-b8eb-14b4e503825e admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:21.110700 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955efada-b803-426f-b8eb-14b4e503825e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:21.110912 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955efada-b803-426f-b8eb-14b4e503825e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:21.138995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 458/917] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:26:21 2022] POST /identity/v3/services => generated 241 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:22.042082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e1ec3-76df-4738-8928-010e737d6769 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:22.042613 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e1ec3-76df-4738-8928-010e737d6769 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:22.042720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e1ec3-76df-4738-8928-010e737d6769 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:22.045153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 460/918] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:22.050466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdc0b0-c7a3-4c40-86be-e9d2a54982d0 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:22.050865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdc0b0-c7a3-4c40-86be-e9d2a54982d0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:22.051073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdc0b0-c7a3-4c40-86be-e9d2a54982d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:22.069757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-25bdc0b0-c7a3-4c40-86be-e9d2a54982d0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:22.070973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-25bdc0b0-c7a3-4c40-86be-e9d2a54982d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:22.087528 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 459/919] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:22 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:22.110039 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e1ec3-76df-4738-8928-010e737d6769 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:22.123601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e1ec3-76df-4738-8928-010e737d6769 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:22.128697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742b488-ed36-4612-ac46-7c4c544f28a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:22.129717 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742b488-ed36-4612-ac46-7c4c544f28a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:22.130217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742b488-ed36-4612-ac46-7c4c544f28a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:22.130699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742b488-ed36-4612-ac46-7c4c544f28a6 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:22.131597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742b488-ed36-4612-ac46-7c4c544f28a6 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:22.133388 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742b488-ed36-4612-ac46-7c4c544f28a6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:22.145051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-f742b488-ed36-4612-ac46-7c4c544f28a6 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 01:26:22.146841 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 461/920] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:26:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:22.156324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdc0b0-c7a3-4c40-86be-e9d2a54982d0 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:22.161387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdc0b0-c7a3-4c40-86be-e9d2a54982d0 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:22.166051 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2308b-fd7b-453c-af56-20efba26f4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:22.166770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2308b-fd7b-453c-af56-20efba26f4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:22.167047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2308b-fd7b-453c-af56-20efba26f4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:22.167317 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2308b-fd7b-453c-af56-20efba26f4d2 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:22.168033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2308b-fd7b-453c-af56-20efba26f4d2 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:22.168334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2308b-fd7b-453c-af56-20efba26f4d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:22.170534 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2308b-fd7b-453c-af56-20efba26f4d2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:22.176296 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 460/921] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:26:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:22.181996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742b488-ed36-4612-ac46-7c4c544f28a6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:22.192480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742b488-ed36-4612-ac46-7c4c544f28a6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:22.197041 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc9005-e87f-4ffe-86f2-9c77580597a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:22.197797 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc9005-e87f-4ffe-86f2-9c77580597a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:22.198083 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc9005-e87f-4ffe-86f2-9c77580597a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:22.198393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc9005-e87f-4ffe-86f2-9c77580597a1 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:22.199103 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc9005-e87f-4ffe-86f2-9c77580597a1 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:22.199404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc9005-e87f-4ffe-86f2-9c77580597a1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:22.201037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc9005-e87f-4ffe-86f2-9c77580597a1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:22.206597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 462/922] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:26:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:22.212202 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2308b-fd7b-453c-af56-20efba26f4d2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:22.222106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2308b-fd7b-453c-af56-20efba26f4d2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:22.226665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964705b5-51a4-4dae-b6ca-97b93d98756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:22.227460 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964705b5-51a4-4dae-b6ca-97b93d98756c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:22.227894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964705b5-51a4-4dae-b6ca-97b93d98756c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:22.228316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964705b5-51a4-4dae-b6ca-97b93d98756c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:22.229238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964705b5-51a4-4dae-b6ca-97b93d98756c admin admin] RBAC: Adding query filter params (interface=public, service_id=ca9baeb0720f484b9db6ceecc556dac4, region_id=RegionOne) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:22.229683 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964705b5-51a4-4dae-b6ca-97b93d98756c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:22.230847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-964705b5-51a4-4dae-b6ca-97b93d98756c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:26:22.230847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:26:22.230847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:26:22.232526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964705b5-51a4-4dae-b6ca-97b93d98756c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:22.240145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 461/923] 10.222.0.79 () {56 vars in 1272 bytes} [Mon Feb 21 01:26:22 2022] GET /identity/v3/endpoints?service_id=ca9baeb0720f484b9db6ceecc556dac4&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:22.245632 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc9005-e87f-4ffe-86f2-9c77580597a1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:22.256155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc9005-e87f-4ffe-86f2-9c77580597a1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:22.260778 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfca5f5-c842-4806-82a2-984d23194d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:22.261608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfca5f5-c842-4806-82a2-984d23194d73 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:22.262037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfca5f5-c842-4806-82a2-984d23194d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:22.262472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfca5f5-c842-4806-82a2-984d23194d73 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:22.263317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfca5f5-c842-4806-82a2-984d23194d73 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:22.265023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfca5f5-c842-4806-82a2-984d23194d73 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:22.271605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 463/924] 10.222.0.79 () {56 vars in 1108 bytes} [Mon Feb 21 01:26:22 2022] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:26:23.053576 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6515cb-94b4-49f6-9f67-cb42cb57d8d9 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.054089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6515cb-94b4-49f6-9f67-cb42cb57d8d9 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.054163 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6515cb-94b4-49f6-9f67-cb42cb57d8d9 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.056155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 462/925] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:23.061622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2231d2-9725-4f1e-825d-46267d44abc9 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.062047 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2231d2-9725-4f1e-825d-46267d44abc9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.062289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2231d2-9725-4f1e-825d-46267d44abc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.081587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-5a2231d2-9725-4f1e-825d-46267d44abc9 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:23.083140 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5a2231d2-9725-4f1e-825d-46267d44abc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:23.091393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 464/926] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:23 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:23.114775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6515cb-94b4-49f6-9f67-cb42cb57d8d9 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.128387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6515cb-94b4-49f6-9f67-cb42cb57d8d9 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.132902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76982365-b68a-4bab-9805-a8d78d1ed5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.134032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76982365-b68a-4bab-9805-a8d78d1ed5ea admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.134547 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76982365-b68a-4bab-9805-a8d78d1ed5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.134998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76982365-b68a-4bab-9805-a8d78d1ed5ea admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.135847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76982365-b68a-4bab-9805-a8d78d1ed5ea admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.137675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76982365-b68a-4bab-9805-a8d78d1ed5ea admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.150813 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-76982365-b68a-4bab-9805-a8d78d1ed5ea admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 01:26:23.152743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 463/927] 10.222.0.79 () {56 vars in 1153 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:23.159050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2231d2-9725-4f1e-825d-46267d44abc9 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.168656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2231d2-9725-4f1e-825d-46267d44abc9 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.173518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5f8f-2747-446f-9d70-f6c9fc9593e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.174435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5f8f-2747-446f-9d70-f6c9fc9593e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.174895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5f8f-2747-446f-9d70-f6c9fc9593e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.175344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5f8f-2747-446f-9d70-f6c9fc9593e3 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.176234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf5f8f-2747-446f-9d70-f6c9fc9593e3 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:23.176714 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf5f8f-2747-446f-9d70-f6c9fc9593e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.178514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf5f8f-2747-446f-9d70-f6c9fc9593e3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.184279 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 465/928] 10.222.0.79 () {56 vars in 1147 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:23.190620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76982365-b68a-4bab-9805-a8d78d1ed5ea admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.201771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76982365-b68a-4bab-9805-a8d78d1ed5ea admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.206585 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfe313-3e66-4c97-9bed-00bb9bfcd1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.207450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe313-3e66-4c97-9bed-00bb9bfcd1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.207911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe313-3e66-4c97-9bed-00bb9bfcd1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.208361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe313-3e66-4c97-9bed-00bb9bfcd1a0 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.209238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfe313-3e66-4c97-9bed-00bb9bfcd1a0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:23.209751 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfe313-3e66-4c97-9bed-00bb9bfcd1a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.211581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfe313-3e66-4c97-9bed-00bb9bfcd1a0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.217029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 464/929] 10.222.0.79 () {56 vars in 1147 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:23.222787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5f8f-2747-446f-9d70-f6c9fc9593e3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.232562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5f8f-2747-446f-9d70-f6c9fc9593e3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.237312 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09abc6-519e-4bed-a2a6-fe53be0b7e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.238269 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09abc6-519e-4bed-a2a6-fe53be0b7e75 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.238756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09abc6-519e-4bed-a2a6-fe53be0b7e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.239215 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09abc6-519e-4bed-a2a6-fe53be0b7e75 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.240134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09abc6-519e-4bed-a2a6-fe53be0b7e75 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.241889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09abc6-519e-4bed-a2a6-fe53be0b7e75 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.264551 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 466/930] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Feb 21 01:26:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:23.416013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da2d5e-05b4-4116-a459-3a0932437571 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.416318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da2d5e-05b4-4116-a459-3a0932437571 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.416481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da2d5e-05b4-4116-a459-3a0932437571 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.418449 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 465/931] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:23.424647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fdb5d-91cd-487b-ba5b-fcb959286610 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.425323 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fdb5d-91cd-487b-ba5b-fcb959286610 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.425802 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fdb5d-91cd-487b-ba5b-fcb959286610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.450175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-e86fdb5d-91cd-487b-ba5b-fcb959286610 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:23.451311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e86fdb5d-91cd-487b-ba5b-fcb959286610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:23.478778 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 467/932] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:23 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:23.504584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da2d5e-05b4-4116-a459-3a0932437571 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.517932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da2d5e-05b4-4116-a459-3a0932437571 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.522646 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae790ed-9975-43ca-8722-5ef7896a9f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.523682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae790ed-9975-43ca-8722-5ef7896a9f74 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.524165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae790ed-9975-43ca-8722-5ef7896a9f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.524616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae790ed-9975-43ca-8722-5ef7896a9f74 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.526845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304fdc-cd79-45d8-b261-e0cd2248e0ac None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.527211 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304fdc-cd79-45d8-b261-e0cd2248e0ac None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.527562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304fdc-cd79-45d8-b261-e0cd2248e0ac None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.529751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 468/933] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:23.535131 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb108b-8428-4510-958f-1f144e941efb None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.535421 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb108b-8428-4510-958f-1f144e941efb None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.535711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb108b-8428-4510-958f-1f144e941efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.539458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae790ed-9975-43ca-8722-5ef7896a9f74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:23.547706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-eae790ed-9975-43ca-8722-5ef7896a9f74 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 01:26:23.549387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 466/934] 10.222.0.79 () {56 vars in 1141 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:23.554723 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-2cfb108b-8428-4510-958f-1f144e941efb None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:23.555419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae790ed-9975-43ca-8722-5ef7896a9f74 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.555918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-2cfb108b-8428-4510-958f-1f144e941efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:23.564519 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 469/935] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:23 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:23.566700 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae790ed-9975-43ca-8722-5ef7896a9f74 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.571561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7cb1f-0bb5-4001-9215-dc008633e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.572365 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7cb1f-0bb5-4001-9215-dc008633e1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.572859 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7cb1f-0bb5-4001-9215-dc008633e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.573275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7cb1f-0bb5-4001-9215-dc008633e1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.575817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7cb1f-0bb5-4001-9215-dc008633e1f5 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:23.575817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7cb1f-0bb5-4001-9215-dc008633e1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.576528 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7cb1f-0bb5-4001-9215-dc008633e1f5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.585782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 467/936] 10.222.0.79 () {56 vars in 1136 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:23.591096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb108b-8428-4510-958f-1f144e941efb None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.591612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7cb1f-0bb5-4001-9215-dc008633e1f5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.600410 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb108b-8428-4510-958f-1f144e941efb None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.601287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7cb1f-0bb5-4001-9215-dc008633e1f5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.605392 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435fed-0a13-4c5f-bb39-ebf2f8c19445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.606265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435fed-0a13-4c5f-bb39-ebf2f8c19445 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.606562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435fed-0a13-4c5f-bb39-ebf2f8c19445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.606672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5f90d-5087-4639-a414-1ffcb006baf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.607423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435fed-0a13-4c5f-bb39-ebf2f8c19445 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.608136 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5435fed-0a13-4c5f-bb39-ebf2f8c19445 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.608434 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5f90d-5087-4639-a414-1ffcb006baf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.608864 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5f90d-5087-4639-a414-1ffcb006baf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.609276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5f90d-5087-4639-a414-1ffcb006baf4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.609810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5435fed-0a13-4c5f-bb39-ebf2f8c19445 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.620526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5f90d-5087-4639-a414-1ffcb006baf4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.621439 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-e5435fed-0a13-4c5f-bb39-ebf2f8c19445 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 01:26:23.623380 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5f90d-5087-4639-a414-1ffcb006baf4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.626289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 470/937] 10.222.0.79 () {56 vars in 1147 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:23.629607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435fed-0a13-4c5f-bb39-ebf2f8c19445 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.640199 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435fed-0a13-4c5f-bb39-ebf2f8c19445 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.646131 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fb16f-1815-4bf5-9c02-43eebff29251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.646989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fb16f-1815-4bf5-9c02-43eebff29251 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.647309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-0bc5f90d-5087-4639-a414-1ffcb006baf4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:23.647584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fb16f-1815-4bf5-9c02-43eebff29251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.648002 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fb16f-1815-4bf5-9c02-43eebff29251 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.648862 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fb16f-1815-4bf5-9c02-43eebff29251 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:23.649389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fb16f-1815-4bf5-9c02-43eebff29251 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.651279 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fb16f-1815-4bf5-9c02-43eebff29251 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.653568 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 468/938] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:23.654892 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5f90d-5087-4639-a414-1ffcb006baf4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.658126 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 471/939] 10.222.0.79 () {56 vars in 1143 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:23.664916 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fb16f-1815-4bf5-9c02-43eebff29251 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.671953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5f90d-5087-4639-a414-1ffcb006baf4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.675904 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fb16f-1815-4bf5-9c02-43eebff29251 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.676874 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12d5c7-7888-4e29-977c-3537200c672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.677686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12d5c7-7888-4e29-977c-3537200c672b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.678188 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12d5c7-7888-4e29-977c-3537200c672b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.678662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12d5c7-7888-4e29-977c-3537200c672b admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.679526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12d5c7-7888-4e29-977c-3537200c672b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:23.679986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12d5c7-7888-4e29-977c-3537200c672b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.681759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12d5c7-7888-4e29-977c-3537200c672b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.682505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba644e88-74c9-4efc-b607-c95226838313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.683299 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba644e88-74c9-4efc-b607-c95226838313 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.683730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba644e88-74c9-4efc-b607-c95226838313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.684143 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba644e88-74c9-4efc-b607-c95226838313 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.685066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba644e88-74c9-4efc-b607-c95226838313 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:23.686051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba644e88-74c9-4efc-b607-c95226838313 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.687802 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba644e88-74c9-4efc-b607-c95226838313 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.693307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 472/940] 10.222.0.79 () {56 vars in 1143 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:23.696247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 469/941] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:23.701441 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba644e88-74c9-4efc-b607-c95226838313 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.702353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12d5c7-7888-4e29-977c-3537200c672b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.712105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba644e88-74c9-4efc-b607-c95226838313 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.715569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12d5c7-7888-4e29-977c-3537200c672b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.717092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5734c-a1f5-40a7-ba46-7350a20cb45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.717873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5734c-a1f5-40a7-ba46-7350a20cb45f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.718291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5734c-a1f5-40a7-ba46-7350a20cb45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.718645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5734c-a1f5-40a7-ba46-7350a20cb45f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.719558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5734c-a1f5-40a7-ba46-7350a20cb45f admin admin] RBAC: Adding query filter params (interface=public, service_id=69fe8760eedb4f1abcf8c0dbbb5fd87a, region_id=RegionOne) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:23.719939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5734c-a1f5-40a7-ba46-7350a20cb45f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.721713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5734c-a1f5-40a7-ba46-7350a20cb45f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.721982 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd01f6-e5f6-4254-894e-4a993f2405ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.722984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd01f6-e5f6-4254-894e-4a993f2405ff admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.723627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd01f6-e5f6-4254-894e-4a993f2405ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.724079 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd01f6-e5f6-4254-894e-4a993f2405ff admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.733278 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 473/942] 10.222.0.79 () {56 vars in 1272 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/endpoints?service_id=69fe8760eedb4f1abcf8c0dbbb5fd87a&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:23.734709 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd01f6-e5f6-4254-894e-4a993f2405ff admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.734821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5734c-a1f5-40a7-ba46-7350a20cb45f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.737239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd01f6-e5f6-4254-894e-4a993f2405ff admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.745548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5734c-a1f5-40a7-ba46-7350a20cb45f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.751132 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72812ef-ccf8-4704-91db-6c05da5aa24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.751833 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72812ef-ccf8-4704-91db-6c05da5aa24e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.752119 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72812ef-ccf8-4704-91db-6c05da5aa24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.752398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72812ef-ccf8-4704-91db-6c05da5aa24e admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.753133 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72812ef-ccf8-4704-91db-6c05da5aa24e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.754792 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72812ef-ccf8-4704-91db-6c05da5aa24e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.755292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-debd01f6-e5f6-4254-894e-4a993f2405ff admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 01:26:23.762626 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 470/944] 10.222.0.79 () {56 vars in 1138 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:23.766397 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 474/944] 10.222.0.79 () {56 vars in 1108 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:26:23.767614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd01f6-e5f6-4254-894e-4a993f2405ff admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.778154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd01f6-e5f6-4254-894e-4a993f2405ff admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.785061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf22c2-f8b4-4ff2-8ff7-af081da68c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.786153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf22c2-f8b4-4ff2-8ff7-af081da68c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.786638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf22c2-f8b4-4ff2-8ff7-af081da68c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.787108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf22c2-f8b4-4ff2-8ff7-af081da68c5c admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.788139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf22c2-f8b4-4ff2-8ff7-af081da68c5c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:23.788644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf22c2-f8b4-4ff2-8ff7-af081da68c5c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.790835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf22c2-f8b4-4ff2-8ff7-af081da68c5c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.812111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 471/945] 10.222.0.79 () {56 vars in 1170 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:23.818094 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72812ef-ccf8-4704-91db-6c05da5aa24e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.828891 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72812ef-ccf8-4704-91db-6c05da5aa24e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.834343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261ab3e-543e-492e-83ce-8d972e6c9e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.835303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261ab3e-543e-492e-83ce-8d972e6c9e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.835732 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261ab3e-543e-492e-83ce-8d972e6c9e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.836192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261ab3e-543e-492e-83ce-8d972e6c9e88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.845651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261ab3e-543e-492e-83ce-8d972e6c9e88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.847736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261ab3e-543e-492e-83ce-8d972e6c9e88 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.860397 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 475/946] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:23.866534 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf22c2-f8b4-4ff2-8ff7-af081da68c5c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.877798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf22c2-f8b4-4ff2-8ff7-af081da68c5c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.883045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217f79b-3f02-4fcd-a4a0-56b60c559159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.884110 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217f79b-3f02-4fcd-a4a0-56b60c559159 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.884560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217f79b-3f02-4fcd-a4a0-56b60c559159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.884986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217f79b-3f02-4fcd-a4a0-56b60c559159 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.896685 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217f79b-3f02-4fcd-a4a0-56b60c559159 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.898939 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217f79b-3f02-4fcd-a4a0-56b60c559159 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.917974 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-d217f79b-3f02-4fcd-a4a0-56b60c559159 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:23.920695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 472/947] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:23.926757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261ab3e-543e-492e-83ce-8d972e6c9e88 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.937779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261ab3e-543e-492e-83ce-8d972e6c9e88 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.943152 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d14fce-828d-4e3b-8d7a-933d94ee6655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.944087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d14fce-828d-4e3b-8d7a-933d94ee6655 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.944786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d14fce-828d-4e3b-8d7a-933d94ee6655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.945480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d14fce-828d-4e3b-8d7a-933d94ee6655 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.947281 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d14fce-828d-4e3b-8d7a-933d94ee6655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:23.947794 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d14fce-828d-4e3b-8d7a-933d94ee6655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.949560 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d14fce-828d-4e3b-8d7a-933d94ee6655 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:23.965149 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 476/948] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:23.971553 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217f79b-3f02-4fcd-a4a0-56b60c559159 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:23.981727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217f79b-3f02-4fcd-a4a0-56b60c559159 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:23.987404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c005712-db80-4c08-9c48-66626c8bbb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:23.988434 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c005712-db80-4c08-9c48-66626c8bbb39 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:23.988905 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c005712-db80-4c08-9c48-66626c8bbb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:23.989318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c005712-db80-4c08-9c48-66626c8bbb39 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:23.996903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c005712-db80-4c08-9c48-66626c8bbb39 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:23.999136 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c005712-db80-4c08-9c48-66626c8bbb39 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:24.012854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-2c005712-db80-4c08-9c48-66626c8bbb39 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:24.014634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 473/949] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:24.020618 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d14fce-828d-4e3b-8d7a-933d94ee6655 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:24.031378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d14fce-828d-4e3b-8d7a-933d94ee6655 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:24.036530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a4504-2a84-4a96-941e-bb184513263d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:24.037393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a4504-2a84-4a96-941e-bb184513263d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:24.037818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a4504-2a84-4a96-941e-bb184513263d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:24.038305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a4504-2a84-4a96-941e-bb184513263d admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:24.039254 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a4504-2a84-4a96-941e-bb184513263d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:24.039756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a4504-2a84-4a96-941e-bb184513263d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:24.042070 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a4504-2a84-4a96-941e-bb184513263d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:24.055549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 477/950] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:24.062456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c005712-db80-4c08-9c48-66626c8bbb39 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:24.073673 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c005712-db80-4c08-9c48-66626c8bbb39 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:24.079341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27774-6f1d-4f68-b47f-fd0ac5093e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:24.080213 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27774-6f1d-4f68-b47f-fd0ac5093e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:24.080640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27774-6f1d-4f68-b47f-fd0ac5093e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:24.081087 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27774-6f1d-4f68-b47f-fd0ac5093e72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:24.082135 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f27774-6f1d-4f68-b47f-fd0ac5093e72 admin admin] RBAC: Adding query filter params (role.id=e0a1a99f5c794f5db82f71def072c7c9, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=19893604215b4bd397178347775e0bb2) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:24.082644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f27774-6f1d-4f68-b47f-fd0ac5093e72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:24.084680 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f27774-6f1d-4f68-b47f-fd0ac5093e72 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:24.100826 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 474/951] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:24 2022] GET /identity/v3/role_assignments?user.id=19893604215b4bd397178347775e0bb2&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=e0a1a99f5c794f5db82f71def072c7c9 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:24.649905 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1b986-95eb-4af6-a23f-b77f5fef9a8d None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:24.650433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1b986-95eb-4af6-a23f-b77f5fef9a8d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:24.650507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1b986-95eb-4af6-a23f-b77f5fef9a8d None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:24.652448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 478/952] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:24.658298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe1f3-6823-45d1-93b0-c5b8e06b8775 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:24.658591 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe1f3-6823-45d1-93b0-c5b8e06b8775 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:24.658870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe1f3-6823-45d1-93b0-c5b8e06b8775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:24.677538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4b2fe1f3-6823-45d1-93b0-c5b8e06b8775 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:24.679362 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4b2fe1f3-6823-45d1-93b0-c5b8e06b8775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:24.689046 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 475/953] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:24 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:24.711469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1b986-95eb-4af6-a23f-b77f5fef9a8d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:24.724050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1b986-95eb-4af6-a23f-b77f5fef9a8d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:24.728449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179571a-d530-4c22-8588-259a168f73e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:24.729223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179571a-d530-4c22-8588-259a168f73e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:24.729503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179571a-d530-4c22-8588-259a168f73e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:24.729772 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179571a-d530-4c22-8588-259a168f73e5 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:24.730447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179571a-d530-4c22-8588-259a168f73e5 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:24.732587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179571a-d530-4c22-8588-259a168f73e5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:24.743360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-d179571a-d530-4c22-8588-259a168f73e5 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 01:26:24.744747 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 479/954] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:26:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:24.750726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fe1f3-6823-45d1-93b0-c5b8e06b8775 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:24.759914 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fe1f3-6823-45d1-93b0-c5b8e06b8775 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:24.764748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf6709-a2d6-4326-866d-ce44749e14db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:24.765634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf6709-a2d6-4326-866d-ce44749e14db admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:24.766165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf6709-a2d6-4326-866d-ce44749e14db admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:24.766760 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf6709-a2d6-4326-866d-ce44749e14db admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:24.767672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf6709-a2d6-4326-866d-ce44749e14db admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:24.768183 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf6709-a2d6-4326-866d-ce44749e14db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:24.770043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf6709-a2d6-4326-866d-ce44749e14db admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:24.775525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 476/955] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:26:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:24.781773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179571a-d530-4c22-8588-259a168f73e5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:24.791330 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179571a-d530-4c22-8588-259a168f73e5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:24.796768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507cc87-c01f-41f9-9a16-51a140d89499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:24.797611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cc87-c01f-41f9-9a16-51a140d89499 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:24.798119 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cc87-c01f-41f9-9a16-51a140d89499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:24.798620 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cc87-c01f-41f9-9a16-51a140d89499 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:24.799500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507cc87-c01f-41f9-9a16-51a140d89499 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:24.799983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507cc87-c01f-41f9-9a16-51a140d89499 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:24.801818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507cc87-c01f-41f9-9a16-51a140d89499 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:24.807385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 480/956] 10.222.0.79 () {56 vars in 1135 bytes} [Mon Feb 21 01:26:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:24.813060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf6709-a2d6-4326-866d-ce44749e14db admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:24.823213 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf6709-a2d6-4326-866d-ce44749e14db admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:24.828102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a13116-7a8a-42f0-84c6-92f09ead27cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:24.828977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13116-7a8a-42f0-84c6-92f09ead27cf admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:24.829500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13116-7a8a-42f0-84c6-92f09ead27cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:24.829964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13116-7a8a-42f0-84c6-92f09ead27cf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:24.830962 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a13116-7a8a-42f0-84c6-92f09ead27cf admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:24.832796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a13116-7a8a-42f0-84c6-92f09ead27cf admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:24.855801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 477/957] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Feb 21 01:26:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:26:25.668313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a6e6e-6073-4b88-ac7c-75b8ee0689e0 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:25.668831 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a6e6e-6073-4b88-ac7c-75b8ee0689e0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:25.668831 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a6e6e-6073-4b88-ac7c-75b8ee0689e0 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:25.671478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 481/958] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:25.676869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41d2d9-c85f-4166-aa87-16972df7035e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:25.677261 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41d2d9-c85f-4166-aa87-16972df7035e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:25.677450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41d2d9-c85f-4166-aa87-16972df7035e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:25.695077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-bc41d2d9-c85f-4166-aa87-16972df7035e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:25.696232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-bc41d2d9-c85f-4166-aa87-16972df7035e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:25.713547 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 478/959] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:25 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:25.737989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a6e6e-6073-4b88-ac7c-75b8ee0689e0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:25.750820 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a6e6e-6073-4b88-ac7c-75b8ee0689e0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:25.755382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df945c7f-463a-450c-ae36-c8b920733ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:25.756164 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df945c7f-463a-450c-ae36-c8b920733ddc admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:25.756444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df945c7f-463a-450c-ae36-c8b920733ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:25.756716 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df945c7f-463a-450c-ae36-c8b920733ddc admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:25.757373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df945c7f-463a-450c-ae36-c8b920733ddc admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:25.759027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df945c7f-463a-450c-ae36-c8b920733ddc admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:25.771026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-df945c7f-463a-450c-ae36-c8b920733ddc admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 01:26:25.772680 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 482/960] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:25.779379 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41d2d9-c85f-4166-aa87-16972df7035e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:25.788822 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41d2d9-c85f-4166-aa87-16972df7035e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:25.793832 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b0fbb-ca26-47ee-b9c2-4767e3e9e219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:25.794592 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b0fbb-ca26-47ee-b9c2-4767e3e9e219 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:25.794875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b0fbb-ca26-47ee-b9c2-4767e3e9e219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:25.795149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b0fbb-ca26-47ee-b9c2-4767e3e9e219 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:25.795882 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b0fbb-ca26-47ee-b9c2-4767e3e9e219 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:25.796190 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b0fbb-ca26-47ee-b9c2-4767e3e9e219 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:25.797839 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b0fbb-ca26-47ee-b9c2-4767e3e9e219 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:25.803608 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 479/961] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:25.809188 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df945c7f-463a-450c-ae36-c8b920733ddc admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:25.820683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df945c7f-463a-450c-ae36-c8b920733ddc admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:25.831528 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab17c3-1b70-4182-a6df-038bf0dc5b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:25.832190 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab17c3-1b70-4182-a6df-038bf0dc5b56 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:25.832473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab17c3-1b70-4182-a6df-038bf0dc5b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:25.832746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab17c3-1b70-4182-a6df-038bf0dc5b56 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:25.833452 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab17c3-1b70-4182-a6df-038bf0dc5b56 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:25.833756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab17c3-1b70-4182-a6df-038bf0dc5b56 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:25.835376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab17c3-1b70-4182-a6df-038bf0dc5b56 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:25.840788 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 483/962] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:26.155511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8fd96-d129-498b-b9f6-04f72edb91cd None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:26.155857 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8fd96-d129-498b-b9f6-04f72edb91cd None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:26.156068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8fd96-d129-498b-b9f6-04f72edb91cd None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:26.158372 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 480/963] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:26.164224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ceebc-2737-4c81-9b56-86c65ddd6e5e None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:26.164540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ceebc-2737-4c81-9b56-86c65ddd6e5e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:26.164781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ceebc-2737-4c81-9b56-86c65ddd6e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:26.183258 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-e25ceebc-2737-4c81-9b56-86c65ddd6e5e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:26.184452 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e25ceebc-2737-4c81-9b56-86c65ddd6e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:26.198309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 484/964] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:26 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:26.217858 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8fd96-d129-498b-b9f6-04f72edb91cd None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:26.230154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8fd96-d129-498b-b9f6-04f72edb91cd None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:26.235253 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d45e6-e260-4fad-bb02-920b8efabfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:26.236048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d45e6-e260-4fad-bb02-920b8efabfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:26.236333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d45e6-e260-4fad-bb02-920b8efabfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:26.236612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d45e6-e260-4fad-bb02-920b8efabfa8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:26.237269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d45e6-e260-4fad-bb02-920b8efabfa8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:26.238899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d45e6-e260-4fad-bb02-920b8efabfa8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:26.250359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-200d45e6-e260-4fad-bb02-920b8efabfa8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 01:26:26.256353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 481/965] 10.222.0.79 () {56 vars in 1147 bytes} [Mon Feb 21 01:26:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:26.257669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ceebc-2737-4c81-9b56-86c65ddd6e5e None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:26.266649 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ceebc-2737-4c81-9b56-86c65ddd6e5e None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:26.271176 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49236108-4078-45a1-8a8a-b143f15c1c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:26.271838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49236108-4078-45a1-8a8a-b143f15c1c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:26.272121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49236108-4078-45a1-8a8a-b143f15c1c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:26.272403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49236108-4078-45a1-8a8a-b143f15c1c6e admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:26.273111 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49236108-4078-45a1-8a8a-b143f15c1c6e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:26.273414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49236108-4078-45a1-8a8a-b143f15c1c6e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:26.275067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49236108-4078-45a1-8a8a-b143f15c1c6e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:26.285258 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 485/966] 10.222.0.79 () {56 vars in 1143 bytes} [Mon Feb 21 01:26:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:26.286616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d45e6-e260-4fad-bb02-920b8efabfa8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:26.296784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d45e6-e260-4fad-bb02-920b8efabfa8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:26.301323 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665bec5-f09d-464d-89c9-803fff6f1d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:26.301980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665bec5-f09d-464d-89c9-803fff6f1d3a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:26.302288 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665bec5-f09d-464d-89c9-803fff6f1d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:26.302568 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665bec5-f09d-464d-89c9-803fff6f1d3a admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:26.303281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665bec5-f09d-464d-89c9-803fff6f1d3a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:26.303584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665bec5-f09d-464d-89c9-803fff6f1d3a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:26.305181 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665bec5-f09d-464d-89c9-803fff6f1d3a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:26.314326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 482/967] 10.222.0.79 () {56 vars in 1143 bytes} [Mon Feb 21 01:26:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:26.315839 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49236108-4078-45a1-8a8a-b143f15c1c6e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:26.325390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49236108-4078-45a1-8a8a-b143f15c1c6e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:26.330475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274ad70-f400-4638-834e-ee7447b877e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:26.331791 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274ad70-f400-4638-834e-ee7447b877e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:26.332702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274ad70-f400-4638-834e-ee7447b877e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:26.332985 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274ad70-f400-4638-834e-ee7447b877e6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:26.333744 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274ad70-f400-4638-834e-ee7447b877e6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:26.335375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274ad70-f400-4638-834e-ee7447b877e6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:26.370499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 486/968] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Feb 21 01:26:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:26:26.546281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ad940-6371-4a50-ad08-76b715c03113 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:26.546648 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ad940-6371-4a50-ad08-76b715c03113 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:26.546841 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ad940-6371-4a50-ad08-76b715c03113 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:26.548782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 483/969] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:26.554307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d76cf-f777-4745-a3c7-cd4f9f0e5a97 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:26.554606 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d76cf-f777-4745-a3c7-cd4f9f0e5a97 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:26.554878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d76cf-f777-4745-a3c7-cd4f9f0e5a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:26.574175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c41d76cf-f777-4745-a3c7-cd4f9f0e5a97 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:26.575434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c41d76cf-f777-4745-a3c7-cd4f9f0e5a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:26.593913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 487/970] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:26 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:26.617746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ad940-6371-4a50-ad08-76b715c03113 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:26.633164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ad940-6371-4a50-ad08-76b715c03113 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:26.637480 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e963736-2496-4269-88bf-ff1bc9f017cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:26.639305 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e963736-2496-4269-88bf-ff1bc9f017cf admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:26.639823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e963736-2496-4269-88bf-ff1bc9f017cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:26.640369 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e963736-2496-4269-88bf-ff1bc9f017cf admin admin] PATH_INFO: `/v3/services/image` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:26.641233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e963736-2496-4269-88bf-ff1bc9f017cf admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:26.643144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e963736-2496-4269-88bf-ff1bc9f017cf admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:26.655769 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-5e963736-2496-4269-88bf-ff1bc9f017cf admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 01:26:26.657845 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 484/971] 10.222.0.79 () {56 vars in 1126 bytes} [Mon Feb 21 01:26:26 2022] GET /identity/v3/services/image => generated 86 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:26.663941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d76cf-f777-4745-a3c7-cd4f9f0e5a97 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:26.673433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d76cf-f777-4745-a3c7-cd4f9f0e5a97 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:26.678792 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc17a4-d3f5-44c6-a98c-a83200a5295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:26.679729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc17a4-d3f5-44c6-a98c-a83200a5295d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:26.680249 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc17a4-d3f5-44c6-a98c-a83200a5295d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:26.680761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc17a4-d3f5-44c6-a98c-a83200a5295d admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:26.681701 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc17a4-d3f5-44c6-a98c-a83200a5295d admin admin] RBAC: Adding query filter params (name=image) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:26.682245 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc17a4-d3f5-44c6-a98c-a83200a5295d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:26.684163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc17a4-d3f5-44c6-a98c-a83200a5295d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:26.690053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 488/972] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:26.696014 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e963736-2496-4269-88bf-ff1bc9f017cf admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:26.708763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e963736-2496-4269-88bf-ff1bc9f017cf admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:26.713747 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22b416-b98c-4d8f-a6d9-ba0ecf126e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:26.714766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22b416-b98c-4d8f-a6d9-ba0ecf126e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:26.715267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22b416-b98c-4d8f-a6d9-ba0ecf126e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:26.715744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22b416-b98c-4d8f-a6d9-ba0ecf126e3c admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:26.717316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22b416-b98c-4d8f-a6d9-ba0ecf126e3c admin admin] RBAC: Adding query filter params (type=image) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:26.717854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22b416-b98c-4d8f-a6d9-ba0ecf126e3c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:26.719835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22b416-b98c-4d8f-a6d9-ba0ecf126e3c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:26.725221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 485/973] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:27.265032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b7fe8-cf15-4bd1-a078-43ad4f751fd0 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:27.265319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b7fe8-cf15-4bd1-a078-43ad4f751fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:27.265594 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b7fe8-cf15-4bd1-a078-43ad4f751fd0 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:27.267585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 489/974] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:27.272821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401340c-6c6a-4eaa-b321-2036eec12f3f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:27.273107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401340c-6c6a-4eaa-b321-2036eec12f3f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:27.273390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401340c-6c6a-4eaa-b321-2036eec12f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:27.290803 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-d401340c-6c6a-4eaa-b321-2036eec12f3f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:27.292051 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d401340c-6c6a-4eaa-b321-2036eec12f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:27.300548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 486/975] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:27 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:27.323825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b7fe8-cf15-4bd1-a078-43ad4f751fd0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:27.335759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b7fe8-cf15-4bd1-a078-43ad4f751fd0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:27.340069 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97850e6-1e8c-47e0-9c0c-f8fc7b4efcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:27.340696 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97850e6-1e8c-47e0-9c0c-f8fc7b4efcaa admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:27.340975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97850e6-1e8c-47e0-9c0c-f8fc7b4efcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:27.341268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97850e6-1e8c-47e0-9c0c-f8fc7b4efcaa admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:27.341965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97850e6-1e8c-47e0-9c0c-f8fc7b4efcaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:27.343871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97850e6-1e8c-47e0-9c0c-f8fc7b4efcaa admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:27.345154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.common [None req-c97850e6-1e8c-47e0-9c0c-f8fc7b4efcaa admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 21 01:26:27.363191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.sql.core [None req-c97850e6-1e8c-47e0-9c0c-f8fc7b4efcaa admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 21 01:26:27.363191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 21 01:26:27.363191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [parameters: {'id': 'a12ad34dcee24b5fa71d2284a3ee88e8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 21 01:26:27.363191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79370) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 01:26:27.379244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-c97850e6-1e8c-47e0-9c0c-f8fc7b4efcaa admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a12ad34dcee24b5fa71d2284a3ee88e8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a12ad34dcee24b5fa71d2284a3ee88e8. Feb 21 01:26:27.381127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 490/976] 10.222.0.79 () {60 vars in 1161 bytes} [Mon Feb 21 01:26:27 2022] POST /identity/v3/projects => generated 262 bytes in 58 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:27.387088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401340c-6c6a-4eaa-b321-2036eec12f3f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:27.397214 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401340c-6c6a-4eaa-b321-2036eec12f3f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:27.403007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1044bc5-3a04-4dea-bddf-25056d90ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:27.404783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1044bc5-3a04-4dea-bddf-25056d90ce1a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:27.405357 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1044bc5-3a04-4dea-bddf-25056d90ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:27.405874 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1044bc5-3a04-4dea-bddf-25056d90ce1a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:27.413693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1044bc5-3a04-4dea-bddf-25056d90ce1a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:27.416110 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1044bc5-3a04-4dea-bddf-25056d90ce1a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:27.430470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-f1044bc5-3a04-4dea-bddf-25056d90ce1a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:27.432198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 487/977] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:27.438501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97850e6-1e8c-47e0-9c0c-f8fc7b4efcaa admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:27.453593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97850e6-1e8c-47e0-9c0c-f8fc7b4efcaa admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:27.458358 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5ffb-96da-44f0-a163-59215deb893c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:27.459008 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5ffb-96da-44f0-a163-59215deb893c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:27.459287 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5ffb-96da-44f0-a163-59215deb893c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:27.459559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5ffb-96da-44f0-a163-59215deb893c admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:27.460317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa5ffb-96da-44f0-a163-59215deb893c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:27.460619 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa5ffb-96da-44f0-a163-59215deb893c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:27.462859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa5ffb-96da-44f0-a163-59215deb893c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:27.485680 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 491/978] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:28.292032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6928-c5c0-4312-98f6-bddeca4858f7 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:28.292544 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6928-c5c0-4312-98f6-bddeca4858f7 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:28.292544 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6928-c5c0-4312-98f6-bddeca4858f7 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:28.294829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 488/979] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:28.300555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e89e-ed29-4eb0-8d44-d117afc33732 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:28.300975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e89e-ed29-4eb0-8d44-d117afc33732 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:28.301142 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e89e-ed29-4eb0-8d44-d117afc33732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:28.339261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-03e8e89e-ed29-4eb0-8d44-d117afc33732 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:28.340799 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-03e8e89e-ed29-4eb0-8d44-d117afc33732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:28.355182 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 492/980] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:28 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:28.379350 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f6928-c5c0-4312-98f6-bddeca4858f7 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:28.397642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f6928-c5c0-4312-98f6-bddeca4858f7 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:28.406453 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b5cd2-ff87-45f8-a261-abdb3745d1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:28.407125 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b5cd2-ff87-45f8-a261-abdb3745d1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:28.407404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b5cd2-ff87-45f8-a261-abdb3745d1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:28.407677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b5cd2-ff87-45f8-a261-abdb3745d1d9 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:28.408413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b5cd2-ff87-45f8-a261-abdb3745d1d9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:28.410010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b5cd2-ff87-45f8-a261-abdb3745d1d9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:28.429720 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 489/981] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:26:28 2022] POST /identity/v3/services => generated 242 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:28.962941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48753e01-169e-4fb3-975d-e003ada53eb6 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:28.963254 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48753e01-169e-4fb3-975d-e003ada53eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:28.963719 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48753e01-169e-4fb3-975d-e003ada53eb6 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:28.965812 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 493/982] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:28.971591 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806b6b8-fe59-498f-acb8-934c3822fe11 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:28.971875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806b6b8-fe59-498f-acb8-934c3822fe11 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:28.972151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806b6b8-fe59-498f-acb8-934c3822fe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:28.990138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-a806b6b8-fe59-498f-acb8-934c3822fe11 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:28.991324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a806b6b8-fe59-498f-acb8-934c3822fe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:29.012882 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 490/983] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:28 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:29.038012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48753e01-169e-4fb3-975d-e003ada53eb6 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:29.051138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48753e01-169e-4fb3-975d-e003ada53eb6 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:29.055655 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae67b1d-d014-4077-ae68-543ebbfba060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:29.056626 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67b1d-d014-4077-ae68-543ebbfba060 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.056907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67b1d-d014-4077-ae68-543ebbfba060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.057175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67b1d-d014-4077-ae68-543ebbfba060 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.057825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae67b1d-d014-4077-ae68-543ebbfba060 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:29.059434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae67b1d-d014-4077-ae68-543ebbfba060 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:29.071271 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-0ae67b1d-d014-4077-ae68-543ebbfba060 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 01:26:29.072758 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 494/984] 10.222.0.79 () {56 vars in 1147 bytes} [Mon Feb 21 01:26:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:29.078725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806b6b8-fe59-498f-acb8-934c3822fe11 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:29.087688 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806b6b8-fe59-498f-acb8-934c3822fe11 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:29.092430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caebe2-2f90-464f-98f0-95f34ba7e851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:29.093095 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caebe2-2f90-464f-98f0-95f34ba7e851 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.093371 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caebe2-2f90-464f-98f0-95f34ba7e851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.093645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caebe2-2f90-464f-98f0-95f34ba7e851 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.094438 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caebe2-2f90-464f-98f0-95f34ba7e851 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:29.094768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caebe2-2f90-464f-98f0-95f34ba7e851 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:29.096582 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caebe2-2f90-464f-98f0-95f34ba7e851 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:29.102168 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 491/985] 10.222.0.79 () {56 vars in 1143 bytes} [Mon Feb 21 01:26:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:29.108294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae67b1d-d014-4077-ae68-543ebbfba060 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:29.118080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae67b1d-d014-4077-ae68-543ebbfba060 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:29.123328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f930219-ef09-4f95-b86b-e79acbb2ae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:29.123976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f930219-ef09-4f95-b86b-e79acbb2ae63 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.124253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f930219-ef09-4f95-b86b-e79acbb2ae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.124773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f930219-ef09-4f95-b86b-e79acbb2ae63 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.125473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f930219-ef09-4f95-b86b-e79acbb2ae63 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:29.125769 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f930219-ef09-4f95-b86b-e79acbb2ae63 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:29.127374 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f930219-ef09-4f95-b86b-e79acbb2ae63 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:29.132830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 495/986] 10.222.0.79 () {56 vars in 1143 bytes} [Mon Feb 21 01:26:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:29.138638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caebe2-2f90-464f-98f0-95f34ba7e851 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:29.148313 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caebe2-2f90-464f-98f0-95f34ba7e851 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:29.152921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d670a-ecae-4f39-bf60-b0b896319c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:29.154123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d670a-ecae-4f39-bf60-b0b896319c89 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.154455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d670a-ecae-4f39-bf60-b0b896319c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.154726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d670a-ecae-4f39-bf60-b0b896319c89 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.155555 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d670a-ecae-4f39-bf60-b0b896319c89 admin admin] RBAC: Adding query filter params (interface=admin, service_id=69fe8760eedb4f1abcf8c0dbbb5fd87a, region_id=RegionOne) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:29.155863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d670a-ecae-4f39-bf60-b0b896319c89 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:29.157620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d670a-ecae-4f39-bf60-b0b896319c89 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:29.163231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 492/987] 10.222.0.79 () {56 vars in 1270 bytes} [Mon Feb 21 01:26:29 2022] GET /identity/v3/endpoints?service_id=69fe8760eedb4f1abcf8c0dbbb5fd87a&interface=admin®ion_id=RegionOne => generated 193 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:29.173926 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d670a-ecae-4f39-bf60-b0b896319c89 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:29.174233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3c95f-cc62-4d57-8192-694866b784f7 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.174233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3c95f-cc62-4d57-8192-694866b784f7 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.174233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3c95f-cc62-4d57-8192-694866b784f7 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.174233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 496/988] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:29.179457 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69db84-50f1-40f8-a1cb-16f93ee9e346 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.179996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69db84-50f1-40f8-a1cb-16f93ee9e346 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.180102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d670a-ecae-4f39-bf60-b0b896319c89 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:29.180596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69db84-50f1-40f8-a1cb-16f93ee9e346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.185059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaba71-ae59-4c60-8f41-ab3626d7854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:29.185714 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaba71-ae59-4c60-8f41-ab3626d7854d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.186048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaba71-ae59-4c60-8f41-ab3626d7854d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.186440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaba71-ae59-4c60-8f41-ab3626d7854d admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.187122 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eaba71-ae59-4c60-8f41-ab3626d7854d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:29.188825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eaba71-ae59-4c60-8f41-ab3626d7854d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:29.195921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 493/989] 10.222.0.79 () {56 vars in 1108 bytes} [Mon Feb 21 01:26:29 2022] GET /identity/v3/services => generated 1727 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:26:29.207724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-ba69db84-50f1-40f8-a1cb-16f93ee9e346 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:29.209314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ba69db84-50f1-40f8-a1cb-16f93ee9e346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:29.219011 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 497/990] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:29 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:29.241953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaba71-ae59-4c60-8f41-ab3626d7854d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:29.253026 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaba71-ae59-4c60-8f41-ab3626d7854d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:29.258518 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248500a9-02a1-4cf7-9510-de1b98dddab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:29.259612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248500a9-02a1-4cf7-9510-de1b98dddab6 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.260145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248500a9-02a1-4cf7-9510-de1b98dddab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.260658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248500a9-02a1-4cf7-9510-de1b98dddab6 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.261797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248500a9-02a1-4cf7-9510-de1b98dddab6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:29.263822 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248500a9-02a1-4cf7-9510-de1b98dddab6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:29.282335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 494/991] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:26:29 2022] POST /identity/v3/services => generated 242 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:29.933838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210e001-0cb6-4489-ae73-58bec07fa0f1 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.934416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210e001-0cb6-4489-ae73-58bec07fa0f1 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.934416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210e001-0cb6-4489-ae73-58bec07fa0f1 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.936994 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 498/992] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:29.942240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695eab3-931f-4bbc-9639-f03bad856886 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.942677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695eab3-931f-4bbc-9639-f03bad856886 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.942779 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695eab3-931f-4bbc-9639-f03bad856886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.961182 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-3695eab3-931f-4bbc-9639-f03bad856886 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:29.962396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3695eab3-931f-4bbc-9639-f03bad856886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:29.979686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 495/993] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:29 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:30.004986 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210e001-0cb6-4489-ae73-58bec07fa0f1 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:30.018475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210e001-0cb6-4489-ae73-58bec07fa0f1 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:30.023242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9d6a5-fba7-4638-b785-be20a5826e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:30.024136 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9d6a5-fba7-4638-b785-be20a5826e7e admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:30.024640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9d6a5-fba7-4638-b785-be20a5826e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:30.025117 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9d6a5-fba7-4638-b785-be20a5826e7e admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:30.026019 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9d6a5-fba7-4638-b785-be20a5826e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:30.028088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9d6a5-fba7-4638-b785-be20a5826e7e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:30.043693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.sql.core [None req-98d9d6a5-fba7-4638-b785-be20a5826e7e admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 21 01:26:30.043693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 21 01:26:30.043693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [parameters: {'user_id': 'd0765efc46c44af69fa9034aece2454a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 21 01:26:30.043693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79370) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 01:26:30.050033 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-98d9d6a5-fba7-4638-b785-be20a5826e7e admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 21 01:26:30.051803 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 499/994] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:26:30 2022] POST /identity/v3/users => generated 160 bytes in 47 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:30.058034 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695eab3-931f-4bbc-9639-f03bad856886 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:30.067804 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695eab3-931f-4bbc-9639-f03bad856886 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:30.072729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81841bb-cbf8-4cf6-a4cc-9ec9bd078616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:30.073773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81841bb-cbf8-4cf6-a4cc-9ec9bd078616 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:30.074271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81841bb-cbf8-4cf6-a4cc-9ec9bd078616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:30.075165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81841bb-cbf8-4cf6-a4cc-9ec9bd078616 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:30.084125 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81841bb-cbf8-4cf6-a4cc-9ec9bd078616 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:30.086419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81841bb-cbf8-4cf6-a4cc-9ec9bd078616 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:30.106251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-d81841bb-cbf8-4cf6-a4cc-9ec9bd078616 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 01:26:30.106251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 496/995] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:26:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:30.108266 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9d6a5-fba7-4638-b785-be20a5826e7e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:30.118557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9d6a5-fba7-4638-b785-be20a5826e7e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:30.123653 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a922a-5e93-4094-8c1e-fe9057c2feae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:30.124558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a922a-5e93-4094-8c1e-fe9057c2feae admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:30.124846 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a922a-5e93-4094-8c1e-fe9057c2feae admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:30.125117 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a922a-5e93-4094-8c1e-fe9057c2feae admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:30.125922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a922a-5e93-4094-8c1e-fe9057c2feae admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:30.126246 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a922a-5e93-4094-8c1e-fe9057c2feae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:30.128346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a922a-5e93-4094-8c1e-fe9057c2feae admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:30.167946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 500/996] 10.222.0.79 () {56 vars in 1122 bytes} [Mon Feb 21 01:26:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:30.874755 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b27064-ab46-40e7-b34e-b0554217bccc None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:30.875160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b27064-ab46-40e7-b34e-b0554217bccc None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:30.875406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b27064-ab46-40e7-b34e-b0554217bccc None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:30.877183 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 497/997] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:30.882788 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d88b7b-94d4-42ae-afc0-163b5a6ea203 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:30.883078 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d88b7b-94d4-42ae-afc0-163b5a6ea203 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:30.883353 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d88b7b-94d4-42ae-afc0-163b5a6ea203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:30.901171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-79d88b7b-94d4-42ae-afc0-163b5a6ea203 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:30.902707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-79d88b7b-94d4-42ae-afc0-163b5a6ea203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:30.911050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 501/998] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:30 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:30.935171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b27064-ab46-40e7-b34e-b0554217bccc None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:30.948786 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b27064-ab46-40e7-b34e-b0554217bccc None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:30.953410 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34592c-adce-40c1-a1d5-ca5d53b629eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:30.954192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34592c-adce-40c1-a1d5-ca5d53b629eb admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:30.954515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34592c-adce-40c1-a1d5-ca5d53b629eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:30.954781 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34592c-adce-40c1-a1d5-ca5d53b629eb admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:30.955436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34592c-adce-40c1-a1d5-ca5d53b629eb admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:30.957064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34592c-adce-40c1-a1d5-ca5d53b629eb admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:30.968401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-9c34592c-adce-40c1-a1d5-ca5d53b629eb admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 01:26:30.969797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 498/999] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:30.975624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d88b7b-94d4-42ae-afc0-163b5a6ea203 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:30.985162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d88b7b-94d4-42ae-afc0-163b5a6ea203 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:30.990112 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd5ff3-069d-435a-8045-f7d81da3f228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:30.990822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd5ff3-069d-435a-8045-f7d81da3f228 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:30.991092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd5ff3-069d-435a-8045-f7d81da3f228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:30.991366 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd5ff3-069d-435a-8045-f7d81da3f228 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:30.992076 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd5ff3-069d-435a-8045-f7d81da3f228 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:30.992385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd5ff3-069d-435a-8045-f7d81da3f228 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:30.994009 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd5ff3-069d-435a-8045-f7d81da3f228 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:30.999258 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 502/1000] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:31.005178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34592c-adce-40c1-a1d5-ca5d53b629eb admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:31.015233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34592c-adce-40c1-a1d5-ca5d53b629eb admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:31.019735 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372039fd-adaf-4c79-8ea7-93aa2bccafd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:31.020388 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372039fd-adaf-4c79-8ea7-93aa2bccafd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.020675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372039fd-adaf-4c79-8ea7-93aa2bccafd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.020952 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372039fd-adaf-4c79-8ea7-93aa2bccafd5 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.021657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372039fd-adaf-4c79-8ea7-93aa2bccafd5 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:31.021962 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372039fd-adaf-4c79-8ea7-93aa2bccafd5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:31.023584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372039fd-adaf-4c79-8ea7-93aa2bccafd5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:31.029160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 499/1001] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:31.034858 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd5ff3-069d-435a-8045-f7d81da3f228 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:31.044388 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd5ff3-069d-435a-8045-f7d81da3f228 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:31.049000 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d613d-eb6a-41dd-b7fc-8dd6268ed7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:31.049648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d613d-eb6a-41dd-b7fc-8dd6268ed7fd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.049944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d613d-eb6a-41dd-b7fc-8dd6268ed7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.050232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d613d-eb6a-41dd-b7fc-8dd6268ed7fd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.051089 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d613d-eb6a-41dd-b7fc-8dd6268ed7fd admin admin] RBAC: Adding query filter params (interface=public, service_id=d069394b57a94ec3bb5bbc0de6035345, region_id=RegionOne) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:31.051407 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d613d-eb6a-41dd-b7fc-8dd6268ed7fd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:31.053004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d613d-eb6a-41dd-b7fc-8dd6268ed7fd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:31.058481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 503/1002] 10.222.0.79 () {56 vars in 1272 bytes} [Mon Feb 21 01:26:31 2022] GET /identity/v3/endpoints?service_id=d069394b57a94ec3bb5bbc0de6035345&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:31.063940 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372039fd-adaf-4c79-8ea7-93aa2bccafd5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:31.073577 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372039fd-adaf-4c79-8ea7-93aa2bccafd5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:31.078873 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cb65f-181c-446f-ad47-cef85385eda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:31.079578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cb65f-181c-446f-ad47-cef85385eda2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.079865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cb65f-181c-446f-ad47-cef85385eda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.080144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cb65f-181c-446f-ad47-cef85385eda2 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.080883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cb65f-181c-446f-ad47-cef85385eda2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:31.082581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cb65f-181c-446f-ad47-cef85385eda2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:31.098371 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 500/1003] 10.222.0.79 () {56 vars in 1108 bytes} [Mon Feb 21 01:26:31 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:26:31.615628 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb25a5-0ae4-451b-b365-6f3f1649ad42 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.615938 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb25a5-0ae4-451b-b365-6f3f1649ad42 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.616228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb25a5-0ae4-451b-b365-6f3f1649ad42 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.618123 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 504/1004] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:31.623618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b9fd5-aeee-49c5-88b9-5d2e12f92da1 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.623902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b9fd5-aeee-49c5-88b9-5d2e12f92da1 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.624174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b9fd5-aeee-49c5-88b9-5d2e12f92da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.642073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2b0b9fd5-aeee-49c5-88b9-5d2e12f92da1 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:31.643269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2b0b9fd5-aeee-49c5-88b9-5d2e12f92da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:31.650784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 501/1005] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:31 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:31.661708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bb0c5-48b9-40ac-95cd-4c099157dfbb None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.661998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bb0c5-48b9-40ac-95cd-4c099157dfbb None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.662312 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bb0c5-48b9-40ac-95cd-4c099157dfbb None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.664233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 505/1006] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:31.669029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38831454-5c1d-4a1c-92ec-99b393ce62ee None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.669303 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38831454-5c1d-4a1c-92ec-99b393ce62ee None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.669581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38831454-5c1d-4a1c-92ec-99b393ce62ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.673390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bb0c5-48b9-40ac-95cd-4c099157dfbb None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:31.685772 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bb0c5-48b9-40ac-95cd-4c099157dfbb None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:31.687634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-38831454-5c1d-4a1c-92ec-99b393ce62ee None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:31.688797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-38831454-5c1d-4a1c-92ec-99b393ce62ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:31.690148 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e52d1-a40f-4d7e-8913-3a82dc047adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:31.690955 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e52d1-a40f-4d7e-8913-3a82dc047adf admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.691271 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e52d1-a40f-4d7e-8913-3a82dc047adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.691506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e52d1-a40f-4d7e-8913-3a82dc047adf admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.692153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e52d1-a40f-4d7e-8913-3a82dc047adf admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:31.693729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e52d1-a40f-4d7e-8913-3a82dc047adf admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:31.696673 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 502/1007] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:31 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:31.705360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-696e52d1-a40f-4d7e-8913-3a82dc047adf admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 01:26:31.706617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 506/1008] 10.222.0.79 () {56 vars in 1147 bytes} [Mon Feb 21 01:26:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:31.712428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38831454-5c1d-4a1c-92ec-99b393ce62ee None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:31.720391 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e52d1-a40f-4d7e-8913-3a82dc047adf admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:31.721662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38831454-5c1d-4a1c-92ec-99b393ce62ee None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:31.726072 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac1f2-b165-4b72-bc32-490ee7a73797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:31.726747 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac1f2-b165-4b72-bc32-490ee7a73797 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.727034 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac1f2-b165-4b72-bc32-490ee7a73797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.727307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac1f2-b165-4b72-bc32-490ee7a73797 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.728005 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaac1f2-b165-4b72-bc32-490ee7a73797 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:31.728308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaac1f2-b165-4b72-bc32-490ee7a73797 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:31.729889 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaac1f2-b165-4b72-bc32-490ee7a73797 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:31.730378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e52d1-a40f-4d7e-8913-3a82dc047adf admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:31.739682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 503/1009] 10.222.0.79 () {56 vars in 1143 bytes} [Mon Feb 21 01:26:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:31.739826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1098a-a274-4d1f-b55a-e2ec726d3319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:31.739826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1098a-a274-4d1f-b55a-e2ec726d3319 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.739826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1098a-a274-4d1f-b55a-e2ec726d3319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.739826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1098a-a274-4d1f-b55a-e2ec726d3319 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.740115 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1098a-a274-4d1f-b55a-e2ec726d3319 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:31.740115 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1098a-a274-4d1f-b55a-e2ec726d3319 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:31.740530 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac1f2-b165-4b72-bc32-490ee7a73797 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:31.750303 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac1f2-b165-4b72-bc32-490ee7a73797 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:31.750800 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-37e1098a-a274-4d1f-b55a-e2ec726d3319 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 01:26:31.752124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 507/1010] 10.222.0.79 () {56 vars in 1126 bytes} [Mon Feb 21 01:26:31 2022] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:31.755096 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8381b2b-42a8-46a7-ae50-fcf1d0b27f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:31.755729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8381b2b-42a8-46a7-ae50-fcf1d0b27f37 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.756011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8381b2b-42a8-46a7-ae50-fcf1d0b27f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.756311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8381b2b-42a8-46a7-ae50-fcf1d0b27f37 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.757080 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8381b2b-42a8-46a7-ae50-fcf1d0b27f37 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:31.757384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8381b2b-42a8-46a7-ae50-fcf1d0b27f37 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:31.757537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1098a-a274-4d1f-b55a-e2ec726d3319 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:31.758987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8381b2b-42a8-46a7-ae50-fcf1d0b27f37 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:31.768655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 504/1011] 10.222.0.79 () {56 vars in 1143 bytes} [Mon Feb 21 01:26:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:31.769498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8381b2b-42a8-46a7-ae50-fcf1d0b27f37 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:31.772580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1098a-a274-4d1f-b55a-e2ec726d3319 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:31.777175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d282dc-04f7-4091-851e-d1fba5ca882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:31.778461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d282dc-04f7-4091-851e-d1fba5ca882f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.778982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d282dc-04f7-4091-851e-d1fba5ca882f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.779111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8381b2b-42a8-46a7-ae50-fcf1d0b27f37 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:31.779490 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d282dc-04f7-4091-851e-d1fba5ca882f admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.780659 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d282dc-04f7-4091-851e-d1fba5ca882f admin admin] RBAC: Adding query filter params (name=image) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:31.780965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d282dc-04f7-4091-851e-d1fba5ca882f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:31.782675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d282dc-04f7-4091-851e-d1fba5ca882f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:31.783816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be6ec-1ed9-4fbb-81b0-621fc9d5e1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:31.784664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be6ec-1ed9-4fbb-81b0-621fc9d5e1fe admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.784664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be6ec-1ed9-4fbb-81b0-621fc9d5e1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.784933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be6ec-1ed9-4fbb-81b0-621fc9d5e1fe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.785670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6be6ec-1ed9-4fbb-81b0-621fc9d5e1fe admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:31.787285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6be6ec-1ed9-4fbb-81b0-621fc9d5e1fe admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:31.787960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 508/1012] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:31.793679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d282dc-04f7-4091-851e-d1fba5ca882f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:31.811310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 505/1013] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Feb 21 01:26:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:31.811596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d282dc-04f7-4091-851e-d1fba5ca882f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:31.823789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1100f8-912d-4e47-b368-7af8f0368cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:31.824470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1100f8-912d-4e47-b368-7af8f0368cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.824749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1100f8-912d-4e47-b368-7af8f0368cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.825084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1100f8-912d-4e47-b368-7af8f0368cd2 admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.825853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1100f8-912d-4e47-b368-7af8f0368cd2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:31.826228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1100f8-912d-4e47-b368-7af8f0368cd2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:31.827999 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1100f8-912d-4e47-b368-7af8f0368cd2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:31.833989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 509/1014] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:31.839859 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be6ec-1ed9-4fbb-81b0-621fc9d5e1fe admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:31.850813 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be6ec-1ed9-4fbb-81b0-621fc9d5e1fe admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:31.855440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c73cd-d6fa-4cda-bb88-bc4b15926d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:31.856209 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c73cd-d6fa-4cda-bb88-bc4b15926d00 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.857107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c73cd-d6fa-4cda-bb88-bc4b15926d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.857457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c73cd-d6fa-4cda-bb88-bc4b15926d00 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.858455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c73cd-d6fa-4cda-bb88-bc4b15926d00 admin admin] RBAC: Adding query filter params (interface=public, service_id=d550d7822518401b8367df5151376bff, region_id=RegionOne) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:31.858842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c73cd-d6fa-4cda-bb88-bc4b15926d00 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:31.860546 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c73cd-d6fa-4cda-bb88-bc4b15926d00 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:31.866766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 506/1015] 10.222.0.79 () {56 vars in 1272 bytes} [Mon Feb 21 01:26:31 2022] GET /identity/v3/endpoints?service_id=d550d7822518401b8367df5151376bff&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:31.873276 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1100f8-912d-4e47-b368-7af8f0368cd2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:31.883809 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1100f8-912d-4e47-b368-7af8f0368cd2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:31.888535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aecc66-4d3c-40ef-a2d4-4c6fa1ffec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:31.889212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aecc66-4d3c-40ef-a2d4-4c6fa1ffec3a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:31.889495 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aecc66-4d3c-40ef-a2d4-4c6fa1ffec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:31.889763 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aecc66-4d3c-40ef-a2d4-4c6fa1ffec3a admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:31.890490 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aecc66-4d3c-40ef-a2d4-4c6fa1ffec3a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:31.892308 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aecc66-4d3c-40ef-a2d4-4c6fa1ffec3a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:31.906456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 510/1016] 10.222.0.79 () {56 vars in 1108 bytes} [Mon Feb 21 01:26:31 2022] GET /identity/v3/services => generated 1957 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:26:33.419782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a467d11-0ea6-4a9b-97f6-31eacdde4114 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:33.420287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a467d11-0ea6-4a9b-97f6-31eacdde4114 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:33.420287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a467d11-0ea6-4a9b-97f6-31eacdde4114 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:33.422174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 507/1017] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:33.427506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c68d1-39f2-447d-a474-380bfaf6ee9b None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:33.427954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c68d1-39f2-447d-a474-380bfaf6ee9b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:33.428046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c68d1-39f2-447d-a474-380bfaf6ee9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:33.445516 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-e99c68d1-39f2-447d-a474-380bfaf6ee9b None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:33.446736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e99c68d1-39f2-447d-a474-380bfaf6ee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:33.455145 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 511/1018] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:33 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:33.478661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a467d11-0ea6-4a9b-97f6-31eacdde4114 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:33.490947 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a467d11-0ea6-4a9b-97f6-31eacdde4114 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:33.495255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d70be-51de-404c-979f-2501e4408040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:33.496043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d70be-51de-404c-979f-2501e4408040 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:33.496324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d70be-51de-404c-979f-2501e4408040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:33.496596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d70be-51de-404c-979f-2501e4408040 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:33.497275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d70be-51de-404c-979f-2501e4408040 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:33.498909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d70be-51de-404c-979f-2501e4408040 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:33.510244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-856d70be-51de-404c-979f-2501e4408040 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 01:26:33.511655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 508/1019] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:33.517941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c68d1-39f2-447d-a474-380bfaf6ee9b None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:33.526844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c68d1-39f2-447d-a474-380bfaf6ee9b None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:33.531368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4333283-6c9a-43c3-bdb5-ef6b0dc5dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:33.532027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333283-6c9a-43c3-bdb5-ef6b0dc5dced admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:33.532304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333283-6c9a-43c3-bdb5-ef6b0dc5dced admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:33.532575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333283-6c9a-43c3-bdb5-ef6b0dc5dced admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:33.533282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4333283-6c9a-43c3-bdb5-ef6b0dc5dced admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:33.533582 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4333283-6c9a-43c3-bdb5-ef6b0dc5dced admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:33.535213 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4333283-6c9a-43c3-bdb5-ef6b0dc5dced admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:33.540520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 512/1020] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:33.546550 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d70be-51de-404c-979f-2501e4408040 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:33.556119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d70be-51de-404c-979f-2501e4408040 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:33.561348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcd471-b18a-41d3-a273-a47ac1bab95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:33.562004 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcd471-b18a-41d3-a273-a47ac1bab95d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:33.562309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcd471-b18a-41d3-a273-a47ac1bab95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:33.562583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcd471-b18a-41d3-a273-a47ac1bab95d admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:33.563288 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcd471-b18a-41d3-a273-a47ac1bab95d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:33.563591 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcd471-b18a-41d3-a273-a47ac1bab95d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:33.565171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcd471-b18a-41d3-a273-a47ac1bab95d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:33.574239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 509/1021] 10.222.0.79 () {56 vars in 1133 bytes} [Mon Feb 21 01:26:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:33.577520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4333283-6c9a-43c3-bdb5-ef6b0dc5dced admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:33.587790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4333283-6c9a-43c3-bdb5-ef6b0dc5dced admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:33.592374 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c08b70-0bc2-41d0-915c-3d61e2c9f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:33.593092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c08b70-0bc2-41d0-915c-3d61e2c9f3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:33.593468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c08b70-0bc2-41d0-915c-3d61e2c9f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:33.593818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c08b70-0bc2-41d0-915c-3d61e2c9f3a1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:33.594674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c08b70-0bc2-41d0-915c-3d61e2c9f3a1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:33.596329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c08b70-0bc2-41d0-915c-3d61e2c9f3a1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:33.626337 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 513/1022] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Feb 21 01:26:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:34.160149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7d109-990b-4ad0-a307-84523004021a None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.160571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7d109-990b-4ad0-a307-84523004021a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.160731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7d109-990b-4ad0-a307-84523004021a None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.162515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 510/1023] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:34.167652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa16d2-b32f-402f-bb53-d3f0ab5de116 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.167943 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa16d2-b32f-402f-bb53-d3f0ab5de116 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.168216 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa16d2-b32f-402f-bb53-d3f0ab5de116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.186592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-67fa16d2-b32f-402f-bb53-d3f0ab5de116 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:34.187751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-67fa16d2-b32f-402f-bb53-d3f0ab5de116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:34.204210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 514/1024] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:34 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:34.227121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7d109-990b-4ad0-a307-84523004021a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:34.239441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7d109-990b-4ad0-a307-84523004021a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:34.243671 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028649d3-d60e-4c47-9416-aa4b1938ef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:34.244445 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028649d3-d60e-4c47-9416-aa4b1938ef89 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.244723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028649d3-d60e-4c47-9416-aa4b1938ef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.244990 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028649d3-d60e-4c47-9416-aa4b1938ef89 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.246128 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028649d3-d60e-4c47-9416-aa4b1938ef89 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:34.248444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028649d3-d60e-4c47-9416-aa4b1938ef89 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:34.250474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 511/1025] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:34.255928 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa16d2-b32f-402f-bb53-d3f0ab5de116 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:34.265214 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa16d2-b32f-402f-bb53-d3f0ab5de116 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:34.269592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6739eb-3a63-453d-8865-22dccce8808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:34.270253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6739eb-3a63-453d-8865-22dccce8808c admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.270535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6739eb-3a63-453d-8865-22dccce8808c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.270807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6739eb-3a63-453d-8865-22dccce8808c admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.271511 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6739eb-3a63-453d-8865-22dccce8808c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:34.273397 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6739eb-3a63-453d-8865-22dccce8808c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:34.286673 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288adda-7910-408f-88f3-f18ecfc536a5 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.286959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288adda-7910-408f-88f3-f18ecfc536a5 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.287526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288adda-7910-408f-88f3-f18ecfc536a5 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.289239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 512/1026] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:26:34.294569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49e945-3ffb-4175-94dd-23525857188d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.294910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49e945-3ffb-4175-94dd-23525857188d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.295186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49e945-3ffb-4175-94dd-23525857188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.303211 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 515/1027] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:26:34 2022] POST /identity/v3/projects => generated 311 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:34.313009 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-aa49e945-3ffb-4175-94dd-23525857188d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:34.314270 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-aa49e945-3ffb-4175-94dd-23525857188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:34.376766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 513/1028] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:34 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:34.400100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6739eb-3a63-453d-8865-22dccce8808c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:34.411274 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6739eb-3a63-453d-8865-22dccce8808c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:34.415907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3519e1-b529-4200-991d-58b606534054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:34.416729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3519e1-b529-4200-991d-58b606534054 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.417001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3519e1-b529-4200-991d-58b606534054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.417283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3519e1-b529-4200-991d-58b606534054 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.417938 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3519e1-b529-4200-991d-58b606534054 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:34.420189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3519e1-b529-4200-991d-58b606534054 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:34.431683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-6d3519e1-b529-4200-991d-58b606534054 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 01:26:34.433128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 516/1029] 10.222.0.79 () {56 vars in 1126 bytes} [Mon Feb 21 01:26:34 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:34.439212 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49e945-3ffb-4175-94dd-23525857188d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:34.448629 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49e945-3ffb-4175-94dd-23525857188d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:34.453398 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cb046-10af-45f8-a571-673b19378d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:34.454150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cb046-10af-45f8-a571-673b19378d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.454548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cb046-10af-45f8-a571-673b19378d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.454894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cb046-10af-45f8-a571-673b19378d5f admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.455695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cb046-10af-45f8-a571-673b19378d5f admin admin] RBAC: Adding query filter params (name=image) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:34.456066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cb046-10af-45f8-a571-673b19378d5f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:34.457862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cb046-10af-45f8-a571-673b19378d5f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:34.463484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 514/1030] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:34.470342 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3519e1-b529-4200-991d-58b606534054 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:34.480861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3519e1-b529-4200-991d-58b606534054 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:34.486822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2893359-49c4-42d0-8d64-b45efc9e793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:34.487487 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2893359-49c4-42d0-8d64-b45efc9e793c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.487765 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2893359-49c4-42d0-8d64-b45efc9e793c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.488040 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2893359-49c4-42d0-8d64-b45efc9e793c admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.488782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2893359-49c4-42d0-8d64-b45efc9e793c admin admin] RBAC: Adding query filter params (type=image) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:34.489058 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2893359-49c4-42d0-8d64-b45efc9e793c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:34.490686 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2893359-49c4-42d0-8d64-b45efc9e793c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:34.496234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 517/1031] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:34.502176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cb046-10af-45f8-a571-673b19378d5f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:34.512325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cb046-10af-45f8-a571-673b19378d5f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:34.516985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bd04b-0162-4533-9d63-a002c22d2871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:34.517676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bd04b-0162-4533-9d63-a002c22d2871 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.517963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bd04b-0162-4533-9d63-a002c22d2871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.518276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bd04b-0162-4533-9d63-a002c22d2871 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.519015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bd04b-0162-4533-9d63-a002c22d2871 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:34.520592 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bd04b-0162-4533-9d63-a002c22d2871 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:34.540662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 515/1032] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Feb 21 01:26:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:36.039309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8938e9a-c903-4328-8bbc-c2266bdff6da None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.039829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8938e9a-c903-4328-8bbc-c2266bdff6da None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.039909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8938e9a-c903-4328-8bbc-c2266bdff6da None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.041623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 518/1033] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:36.047468 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a02c1a-79d7-4109-85e3-1c7c0a97291c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.047853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a02c1a-79d7-4109-85e3-1c7c0a97291c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.048028 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a02c1a-79d7-4109-85e3-1c7c0a97291c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.066031 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-88a02c1a-79d7-4109-85e3-1c7c0a97291c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:36.067231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-88a02c1a-79d7-4109-85e3-1c7c0a97291c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:36.084865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 516/1034] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:36.109014 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8938e9a-c903-4328-8bbc-c2266bdff6da None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.121196 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8938e9a-c903-4328-8bbc-c2266bdff6da None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.126506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310e375-ffe9-4b85-b292-c70e13c3c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.127302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310e375-ffe9-4b85-b292-c70e13c3c65c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.127583 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310e375-ffe9-4b85-b292-c70e13c3c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.127856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310e375-ffe9-4b85-b292-c70e13c3c65c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.139168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310e375-ffe9-4b85-b292-c70e13c3c65c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:36.146483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-e310e375-ffe9-4b85-b292-c70e13c3c65c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 01:26:36.147670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 519/1035] 10.222.0.79 () {56 vars in 1141 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:36.153535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a02c1a-79d7-4109-85e3-1c7c0a97291c None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.162828 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a02c1a-79d7-4109-85e3-1c7c0a97291c None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.167366 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb9456-cfa0-46ad-8026-ac0957b7108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.168098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9456-cfa0-46ad-8026-ac0957b7108f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.168457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9456-cfa0-46ad-8026-ac0957b7108f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.168807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9456-cfa0-46ad-8026-ac0957b7108f admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.169645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb9456-cfa0-46ad-8026-ac0957b7108f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:36.170022 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb9456-cfa0-46ad-8026-ac0957b7108f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.171889 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb9456-cfa0-46ad-8026-ac0957b7108f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.184352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 517/1036] 10.222.0.79 () {56 vars in 1136 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:36.186052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310e375-ffe9-4b85-b292-c70e13c3c65c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.196345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310e375-ffe9-4b85-b292-c70e13c3c65c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.201588 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7e0ae-6ad1-456a-b2a8-c1dfec51b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.202390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e0ae-6ad1-456a-b2a8-c1dfec51b486 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.202676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e0ae-6ad1-456a-b2a8-c1dfec51b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.203098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e0ae-6ad1-456a-b2a8-c1dfec51b486 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.213237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e0ae-6ad1-456a-b2a8-c1dfec51b486 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.215099 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e0ae-6ad1-456a-b2a8-c1dfec51b486 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.233971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-b0c7e0ae-6ad1-456a-b2a8-c1dfec51b486 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:36.238234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 520/1037] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:36.241270 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb9456-cfa0-46ad-8026-ac0957b7108f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.251194 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb9456-cfa0-46ad-8026-ac0957b7108f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.255676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e19573-240a-4ac4-b3bb-8dc4fba05135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.256569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e19573-240a-4ac4-b3bb-8dc4fba05135 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.256925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e19573-240a-4ac4-b3bb-8dc4fba05135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.257270 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e19573-240a-4ac4-b3bb-8dc4fba05135 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.258062 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e19573-240a-4ac4-b3bb-8dc4fba05135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:36.258472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e19573-240a-4ac4-b3bb-8dc4fba05135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.260148 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e19573-240a-4ac4-b3bb-8dc4fba05135 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.277292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 518/1038] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:36.279240 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7e0ae-6ad1-456a-b2a8-c1dfec51b486 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.289620 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7e0ae-6ad1-456a-b2a8-c1dfec51b486 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.294236 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bd028-a20a-46bb-87d9-b0264cf51bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.295073 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bd028-a20a-46bb-87d9-b0264cf51bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.295352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bd028-a20a-46bb-87d9-b0264cf51bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.295623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bd028-a20a-46bb-87d9-b0264cf51bd0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.303914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bd028-a20a-46bb-87d9-b0264cf51bd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.305972 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bd028-a20a-46bb-87d9-b0264cf51bd0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.440932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-ef5bd028-a20a-46bb-87d9-b0264cf51bd0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:26:36.442307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 521/1039] 10.222.0.79 () {56 vars in 1114 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:36.447798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e19573-240a-4ac4-b3bb-8dc4fba05135 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.459005 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e19573-240a-4ac4-b3bb-8dc4fba05135 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.464635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ab3e5-af47-4c3a-8e9a-1735da95eb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.465300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ab3e5-af47-4c3a-8e9a-1735da95eb85 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.465598 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ab3e5-af47-4c3a-8e9a-1735da95eb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.466442 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ab3e5-af47-4c3a-8e9a-1735da95eb85 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.467280 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ab3e5-af47-4c3a-8e9a-1735da95eb85 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:36.467588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ab3e5-af47-4c3a-8e9a-1735da95eb85 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.469559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ab3e5-af47-4c3a-8e9a-1735da95eb85 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.487207 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 519/1040] 10.222.0.79 () {56 vars in 1154 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:36.492665 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bd028-a20a-46bb-87d9-b0264cf51bd0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.503341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bd028-a20a-46bb-87d9-b0264cf51bd0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.508393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb34c2-c091-43cd-8cbb-57c369d399f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.509110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb34c2-c091-43cd-8cbb-57c369d399f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.509386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb34c2-c091-43cd-8cbb-57c369d399f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.509700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb34c2-c091-43cd-8cbb-57c369d399f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.519680 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb34c2-c091-43cd-8cbb-57c369d399f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.521464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb34c2-c091-43cd-8cbb-57c369d399f0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.536544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 522/1041] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:36.537872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ab3e5-af47-4c3a-8e9a-1735da95eb85 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.548234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ab3e5-af47-4c3a-8e9a-1735da95eb85 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.552727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc938a-9960-420c-b5f7-e8048a81689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.553589 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc938a-9960-420c-b5f7-e8048a81689b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.553940 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc938a-9960-420c-b5f7-e8048a81689b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.554321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc938a-9960-420c-b5f7-e8048a81689b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.565164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc938a-9960-420c-b5f7-e8048a81689b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.567028 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc938a-9960-420c-b5f7-e8048a81689b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.585731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-47fc938a-9960-420c-b5f7-e8048a81689b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:36.587167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 520/1042] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:36.593335 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb34c2-c091-43cd-8cbb-57c369d399f0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.602280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb34c2-c091-43cd-8cbb-57c369d399f0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.607456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423ab51-eb98-4b55-bc81-3e50ee9e95f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.608177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ab51-eb98-4b55-bc81-3e50ee9e95f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.608519 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ab51-eb98-4b55-bc81-3e50ee9e95f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.608854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ab51-eb98-4b55-bc81-3e50ee9e95f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.609689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ab51-eb98-4b55-bc81-3e50ee9e95f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:36.610072 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ab51-eb98-4b55-bc81-3e50ee9e95f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.611954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ab51-eb98-4b55-bc81-3e50ee9e95f1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.625446 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 523/1043] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:36.630847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc938a-9960-420c-b5f7-e8048a81689b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.640401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc938a-9960-420c-b5f7-e8048a81689b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.644837 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ccea7-3ea3-4792-aa19-fad78ca907d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.645613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ccea7-3ea3-4792-aa19-fad78ca907d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.645890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ccea7-3ea3-4792-aa19-fad78ca907d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.646158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ccea7-3ea3-4792-aa19-fad78ca907d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.653115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ccea7-3ea3-4792-aa19-fad78ca907d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.655681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ccea7-3ea3-4792-aa19-fad78ca907d6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.656494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca6de4-47ae-4477-9269-fb352ec83035 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.656788 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca6de4-47ae-4477-9269-fb352ec83035 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.657064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca6de4-47ae-4477-9269-fb352ec83035 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.658883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 524/1044] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:26:36.663790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808f2cb-471f-420a-b247-e998c1f42875 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.664072 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808f2cb-471f-420a-b247-e998c1f42875 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.664344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808f2cb-471f-420a-b247-e998c1f42875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.668712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-322ccea7-3ea3-4792-aa19-fad78ca907d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:36.670610 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 521/1045] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:36.675978 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ccea7-3ea3-4792-aa19-fad78ca907d6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.683192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-6808f2cb-471f-420a-b247-e998c1f42875 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:36.684761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6808f2cb-471f-420a-b247-e998c1f42875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:36.685797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ccea7-3ea3-4792-aa19-fad78ca907d6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.690392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451e72a-6dd0-4ff7-ae6a-3cdee9fc4d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.691029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451e72a-6dd0-4ff7-ae6a-3cdee9fc4d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.691306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451e72a-6dd0-4ff7-ae6a-3cdee9fc4d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.691575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451e72a-6dd0-4ff7-ae6a-3cdee9fc4d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.692347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451e72a-6dd0-4ff7-ae6a-3cdee9fc4d24 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:36.692650 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451e72a-6dd0-4ff7-ae6a-3cdee9fc4d24 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.693438 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 525/1046] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:36.694497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451e72a-6dd0-4ff7-ae6a-3cdee9fc4d24 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.708489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 522/1047] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:36.714242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808f2cb-471f-420a-b247-e998c1f42875 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.718640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451e72a-6dd0-4ff7-ae6a-3cdee9fc4d24 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.724128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808f2cb-471f-420a-b247-e998c1f42875 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.728533 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522b763-4f9c-4980-be3c-33d1d6dba304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.729121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451e72a-6dd0-4ff7-ae6a-3cdee9fc4d24 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.729224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522b763-4f9c-4980-be3c-33d1d6dba304 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.729433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522b763-4f9c-4980-be3c-33d1d6dba304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.729736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522b763-4f9c-4980-be3c-33d1d6dba304 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.730559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522b763-4f9c-4980-be3c-33d1d6dba304 admin admin] RBAC: Adding query filter params (role.id=e0a1a99f5c794f5db82f71def072c7c9, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=333ec5b3842b432a99bc265abbe7fa58) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:36.730865 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522b763-4f9c-4980-be3c-33d1d6dba304 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.733283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522b763-4f9c-4980-be3c-33d1d6dba304 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.734299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84a56b-22d6-4778-befc-03333eea8b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.735266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84a56b-22d6-4778-befc-03333eea8b0d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.735553 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84a56b-22d6-4778-befc-03333eea8b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.735826 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84a56b-22d6-4778-befc-03333eea8b0d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.737729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84a56b-22d6-4778-befc-03333eea8b0d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.739118 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 526/1048] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/role_assignments?user.id=333ec5b3842b432a99bc265abbe7fa58&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=e0a1a99f5c794f5db82f71def072c7c9 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:36.739441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84a56b-22d6-4778-befc-03333eea8b0d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.745715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 523/1049] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:36.747255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522b763-4f9c-4980-be3c-33d1d6dba304 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.757859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522b763-4f9c-4980-be3c-33d1d6dba304 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.762675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94aa4c-f19b-4b27-ba80-7021035d2a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.763494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94aa4c-f19b-4b27-ba80-7021035d2a95 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.763836 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94aa4c-f19b-4b27-ba80-7021035d2a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.764177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94aa4c-f19b-4b27-ba80-7021035d2a95 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.764979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94aa4c-f19b-4b27-ba80-7021035d2a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.767050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94aa4c-f19b-4b27-ba80-7021035d2a95 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.790372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 527/1050] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:26:36 2022] POST /identity/v3/users => generated 285 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:36.881629 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e438-8e35-41d8-acba-a61ff4b398af None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.881832 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e438-8e35-41d8-acba-a61ff4b398af None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.882098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e438-8e35-41d8-acba-a61ff4b398af None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.884176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 524/1051] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:36.889997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d24df-9f9c-4376-be1e-b590f1b173b7 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.890349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d24df-9f9c-4376-be1e-b590f1b173b7 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.890587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d24df-9f9c-4376-be1e-b590f1b173b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.910073 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-9a4d24df-9f9c-4376-be1e-b590f1b173b7 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:36.911339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9a4d24df-9f9c-4376-be1e-b590f1b173b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:36.920211 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 528/1052] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:36.943517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50e438-8e35-41d8-acba-a61ff4b398af None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.956159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50e438-8e35-41d8-acba-a61ff4b398af None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:36.960770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbb4fc-57f5-4183-b831-b530cfe56c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:36.961430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbb4fc-57f5-4183-b831-b530cfe56c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:36.961709 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbb4fc-57f5-4183-b831-b530cfe56c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:36.961981 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbb4fc-57f5-4183-b831-b530cfe56c69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:36.971102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbb4fc-57f5-4183-b831-b530cfe56c69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:36.972900 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbb4fc-57f5-4183-b831-b530cfe56c69 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:36.983224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 525/1053] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:36.989036 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d24df-9f9c-4376-be1e-b590f1b173b7 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:36.998375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d24df-9f9c-4376-be1e-b590f1b173b7 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:37.003622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63036c8-df12-4ff1-842d-dd36b5de0ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:37.004643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63036c8-df12-4ff1-842d-dd36b5de0ecd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:37.004929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63036c8-df12-4ff1-842d-dd36b5de0ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:37.005197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63036c8-df12-4ff1-842d-dd36b5de0ecd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:37.006954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63036c8-df12-4ff1-842d-dd36b5de0ecd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:37.008648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63036c8-df12-4ff1-842d-dd36b5de0ecd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:37.010289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 529/1054] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:39.032232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29cf45-ba82-4257-8ae8-0f027db88fdb None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.032806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29cf45-ba82-4257-8ae8-0f027db88fdb None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.032806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29cf45-ba82-4257-8ae8-0f027db88fdb None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.034639 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 526/1055] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:39.039826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b81c66-02dd-4cd2-8af1-bffebfd923c9 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.040224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b81c66-02dd-4cd2-8af1-bffebfd923c9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.040487 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b81c66-02dd-4cd2-8af1-bffebfd923c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.057739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-50b81c66-02dd-4cd2-8af1-bffebfd923c9 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:39.058924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-50b81c66-02dd-4cd2-8af1-bffebfd923c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:39.067095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 530/1056] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:39.093008 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29cf45-ba82-4257-8ae8-0f027db88fdb None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.103249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29cf45-ba82-4257-8ae8-0f027db88fdb None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.107635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1569a9-a9ec-4b38-87a9-fa8eff162d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.108497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1569a9-a9ec-4b38-87a9-fa8eff162d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.108785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1569a9-a9ec-4b38-87a9-fa8eff162d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.109138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1569a9-a9ec-4b38-87a9-fa8eff162d64 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.119431 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1569a9-a9ec-4b38-87a9-fa8eff162d64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:39.127485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-ce1569a9-a9ec-4b38-87a9-fa8eff162d64 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 01:26:39.128661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 527/1057] 10.222.0.79 () {56 vars in 1141 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:39.134625 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b81c66-02dd-4cd2-8af1-bffebfd923c9 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.144391 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b81c66-02dd-4cd2-8af1-bffebfd923c9 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.148881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2cdea-9544-49d6-8c64-bf7a793c2275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.149535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2cdea-9544-49d6-8c64-bf7a793c2275 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.149815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2cdea-9544-49d6-8c64-bf7a793c2275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.150089 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2cdea-9544-49d6-8c64-bf7a793c2275 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.150873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2cdea-9544-49d6-8c64-bf7a793c2275 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:39.151176 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2cdea-9544-49d6-8c64-bf7a793c2275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.153578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2cdea-9544-49d6-8c64-bf7a793c2275 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.163066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 531/1058] 10.222.0.79 () {56 vars in 1136 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:39.168857 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1569a9-a9ec-4b38-87a9-fa8eff162d64 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.177656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e34abc-64bd-4ad8-951b-224d1eb3ead9 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.177947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e34abc-64bd-4ad8-951b-224d1eb3ead9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.178248 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e34abc-64bd-4ad8-951b-224d1eb3ead9 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.179297 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1569a9-a9ec-4b38-87a9-fa8eff162d64 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.179978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 532/1059] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:26:39.184012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d01a28-650b-4ebe-adaa-67d1d30f5497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.185280 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d01a28-650b-4ebe-adaa-67d1d30f5497 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.185387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33968-4af2-454c-86fa-8c57dd0eef06 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.185561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d01a28-650b-4ebe-adaa-67d1d30f5497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.185663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33968-4af2-454c-86fa-8c57dd0eef06 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.185834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d01a28-650b-4ebe-adaa-67d1d30f5497 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.185931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33968-4af2-454c-86fa-8c57dd0eef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.195845 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d01a28-650b-4ebe-adaa-67d1d30f5497 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.197667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d01a28-650b-4ebe-adaa-67d1d30f5497 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.203674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-cae33968-4af2-454c-86fa-8c57dd0eef06 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:39.204841 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-cae33968-4af2-454c-86fa-8c57dd0eef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:39.212407 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 533/1060] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:39.214371 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-18d01a28-650b-4ebe-adaa-67d1d30f5497 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:39.215539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 528/1061] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:39.221004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae33968-4af2-454c-86fa-8c57dd0eef06 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.230109 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae33968-4af2-454c-86fa-8c57dd0eef06 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.235266 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2375286-9c91-4b04-988c-d6efb52c309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.235900 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2375286-9c91-4b04-988c-d6efb52c309a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.236147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d01a28-650b-4ebe-adaa-67d1d30f5497 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.236243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2375286-9c91-4b04-988c-d6efb52c309a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.236445 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2375286-9c91-4b04-988c-d6efb52c309a admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.237168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2375286-9c91-4b04-988c-d6efb52c309a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:39.237479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2375286-9c91-4b04-988c-d6efb52c309a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.239105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2375286-9c91-4b04-988c-d6efb52c309a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.245300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d01a28-650b-4ebe-adaa-67d1d30f5497 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.250596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9df13-fe33-4345-9808-edffa52d94b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.251240 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 534/1062] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:39.251361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9df13-fe33-4345-9808-edffa52d94b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.251613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9df13-fe33-4345-9808-edffa52d94b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.251890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9df13-fe33-4345-9808-edffa52d94b7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.256518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2375286-9c91-4b04-988c-d6efb52c309a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.261699 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9df13-fe33-4345-9808-edffa52d94b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:39.265486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2375286-9c91-4b04-988c-d6efb52c309a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.268490 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-7ea9df13-fe33-4345-9808-edffa52d94b7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:26:39.269624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 529/1063] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:39.270720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535889f-c55c-4097-b224-59abf7f2f22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.271480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535889f-c55c-4097-b224-59abf7f2f22d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.271765 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535889f-c55c-4097-b224-59abf7f2f22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.272040 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535889f-c55c-4097-b224-59abf7f2f22d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.275217 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9df13-fe33-4345-9808-edffa52d94b7 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.279584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535889f-c55c-4097-b224-59abf7f2f22d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.281581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535889f-c55c-4097-b224-59abf7f2f22d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.284407 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9df13-fe33-4345-9808-edffa52d94b7 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.288920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f51a9-1253-4478-8e5f-efc635d7cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.289546 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f51a9-1253-4478-8e5f-efc635d7cfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.289829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f51a9-1253-4478-8e5f-efc635d7cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.290104 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f51a9-1253-4478-8e5f-efc635d7cfb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.290910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f51a9-1253-4478-8e5f-efc635d7cfb6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:39.291215 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f51a9-1253-4478-8e5f-efc635d7cfb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.292803 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f51a9-1253-4478-8e5f-efc635d7cfb6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.294975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-c535889f-c55c-4097-b224-59abf7f2f22d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:26:39.296128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 535/1064] 10.222.0.79 () {56 vars in 1114 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:39.301603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535889f-c55c-4097-b224-59abf7f2f22d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.302261 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 530/1065] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:39.307473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f51a9-1253-4478-8e5f-efc635d7cfb6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.311790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535889f-c55c-4097-b224-59abf7f2f22d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.316222 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea724045-b46e-4b19-a7f8-c95e5ab4787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.316838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea724045-b46e-4b19-a7f8-c95e5ab4787f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.316939 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f51a9-1253-4478-8e5f-efc635d7cfb6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.317112 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea724045-b46e-4b19-a7f8-c95e5ab4787f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.317382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea724045-b46e-4b19-a7f8-c95e5ab4787f admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.318229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea724045-b46e-4b19-a7f8-c95e5ab4787f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:39.318537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea724045-b46e-4b19-a7f8-c95e5ab4787f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.320335 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea724045-b46e-4b19-a7f8-c95e5ab4787f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.321433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8296c01-695d-49bb-b6c2-283532c018ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.322272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8296c01-695d-49bb-b6c2-283532c018ef admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.322559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8296c01-695d-49bb-b6c2-283532c018ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.322841 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8296c01-695d-49bb-b6c2-283532c018ef admin admin] PATH_INFO: `/v3/users/e6f117484e9441bfbc013e485a1038db` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.335976 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8296c01-695d-49bb-b6c2-283532c018ef admin admin] RBAC: Authorizing `identity:get_user(user_id=e6f117484e9441bfbc013e485a1038db)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.338107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8296c01-695d-49bb-b6c2-283532c018ef admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.338924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 536/1066] 10.222.0.79 () {56 vars in 1154 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:39.340004 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 531/1067] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/users/e6f117484e9441bfbc013e485a1038db => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:39.345353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8296c01-695d-49bb-b6c2-283532c018ef admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.345488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea724045-b46e-4b19-a7f8-c95e5ab4787f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.354463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8296c01-695d-49bb-b6c2-283532c018ef admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.354612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea724045-b46e-4b19-a7f8-c95e5ab4787f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.359523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fad49-c12f-4163-8242-d0bce7c424f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.359650 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67748787-a15d-4dd7-9da5-76852614521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.360138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fad49-c12f-4163-8242-d0bce7c424f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.360286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67748787-a15d-4dd7-9da5-76852614521a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.360415 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fad49-c12f-4163-8242-d0bce7c424f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.360570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67748787-a15d-4dd7-9da5-76852614521a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.360686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fad49-c12f-4163-8242-d0bce7c424f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.360846 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67748787-a15d-4dd7-9da5-76852614521a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.368179 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fad49-c12f-4163-8242-d0bce7c424f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.369873 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fad49-c12f-4163-8242-d0bce7c424f0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.370756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67748787-a15d-4dd7-9da5-76852614521a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.373132 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67748787-a15d-4dd7-9da5-76852614521a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.379412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 532/1068] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:39.384878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fad49-c12f-4163-8242-d0bce7c424f0 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.389683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-67748787-a15d-4dd7-9da5-76852614521a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:39.390841 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 537/1069] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:39.394637 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fad49-c12f-4163-8242-d0bce7c424f0 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.396095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67748787-a15d-4dd7-9da5-76852614521a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.398526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139d595-0588-4aca-81a6-bfbf881ff750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.399332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139d595-0588-4aca-81a6-bfbf881ff750 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.399612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139d595-0588-4aca-81a6-bfbf881ff750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.399883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139d595-0588-4aca-81a6-bfbf881ff750 admin admin] PATH_INFO: `/v3/projects/ba6b5e4f592240928c05444f6c31cea0` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.401035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139d595-0588-4aca-81a6-bfbf881ff750 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba6b5e4f592240928c05444f6c31cea0)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.403115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139d595-0588-4aca-81a6-bfbf881ff750 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.404725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 533/1070] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/projects/ba6b5e4f592240928c05444f6c31cea0 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:39.405253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67748787-a15d-4dd7-9da5-76852614521a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.409709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7992-f550-42d1-ac71-ea9017e3e95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.410271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139d595-0588-4aca-81a6-bfbf881ff750 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.410405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7992-f550-42d1-ac71-ea9017e3e95c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.410620 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7992-f550-42d1-ac71-ea9017e3e95c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.410898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7992-f550-42d1-ac71-ea9017e3e95c admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.411600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7992-f550-42d1-ac71-ea9017e3e95c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:39.411903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7992-f550-42d1-ac71-ea9017e3e95c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.413451 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7992-f550-42d1-ac71-ea9017e3e95c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.419651 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139d595-0588-4aca-81a6-bfbf881ff750 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.424982 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9c43-c348-4ba2-ae0c-c627c551fe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.425583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9c43-c348-4ba2-ae0c-c627c551fe95 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.425859 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9c43-c348-4ba2-ae0c-c627c551fe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.425963 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 538/1071] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:39.426133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9c43-c348-4ba2-ae0c-c627c551fe95 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.426958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a9c43-c348-4ba2-ae0c-c627c551fe95 admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=ba6b5e4f592240928c05444f6c31cea0, user.id=e6f117484e9441bfbc013e485a1038db) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:39.427262 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a9c43-c348-4ba2-ae0c-c627c551fe95 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.429036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a9c43-c348-4ba2-ae0c-c627c551fe95 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.431232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7992-f550-42d1-ac71-ea9017e3e95c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.437489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 534/1072] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/role_assignments?user.id=e6f117484e9441bfbc013e485a1038db&scope.project.id=ba6b5e4f592240928c05444f6c31cea0&role.id=548abad662724741a3261205ee7cb828 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:39.442963 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7992-f550-42d1-ac71-ea9017e3e95c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.447833 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3ea9c-550e-4e48-b21f-7a221067884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.448799 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3ea9c-550e-4e48-b21f-7a221067884a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.449300 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3ea9c-550e-4e48-b21f-7a221067884a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.449795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3ea9c-550e-4e48-b21f-7a221067884a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.459670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3ea9c-550e-4e48-b21f-7a221067884a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.461745 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3ea9c-550e-4e48-b21f-7a221067884a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.478978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-68a3ea9c-550e-4e48-b21f-7a221067884a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:39.486298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 539/1073] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:39.487534 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9c43-c348-4ba2-ae0c-c627c551fe95 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.498520 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9c43-c348-4ba2-ae0c-c627c551fe95 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.506383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a83b6-e232-46fd-a597-73c1acd4e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.507059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a83b6-e232-46fd-a597-73c1acd4e957 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.507338 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a83b6-e232-46fd-a597-73c1acd4e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.507611 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a83b6-e232-46fd-a597-73c1acd4e957 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.508398 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a83b6-e232-46fd-a597-73c1acd4e957 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:39.508703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a83b6-e232-46fd-a597-73c1acd4e957 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.510587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a83b6-e232-46fd-a597-73c1acd4e957 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.528085 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 535/1074] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:39.529347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3ea9c-550e-4e48-b21f-7a221067884a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.539473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3ea9c-550e-4e48-b21f-7a221067884a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.544468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a825e-bc62-404b-b2b1-d43719af89cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.545363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a825e-bc62-404b-b2b1-d43719af89cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.545643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a825e-bc62-404b-b2b1-d43719af89cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.545915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a825e-bc62-404b-b2b1-d43719af89cd admin admin] PATH_INFO: `/v3/projects/0eaab085a52a4171be0afec37707daca/users/333ec5b3842b432a99bc265abbe7fa58/roles/e0a1a99f5c794f5db82f71def072c7c9` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.548203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a825e-bc62-404b-b2b1-d43719af89cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaab085a52a4171be0afec37707daca, user_id=333ec5b3842b432a99bc265abbe7fa58, role_id=e0a1a99f5c794f5db82f71def072c7c9)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.550907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a825e-bc62-404b-b2b1-d43719af89cd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.565509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 540/1075] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:26:39 2022] PUT /identity/v3/projects/0eaab085a52a4171be0afec37707daca/users/333ec5b3842b432a99bc265abbe7fa58/roles/e0a1a99f5c794f5db82f71def072c7c9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:26:41.721540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253beff-27d7-4729-a764-1b3908b5012e None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:41.722068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253beff-27d7-4729-a764-1b3908b5012e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:41.722068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253beff-27d7-4729-a764-1b3908b5012e None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:41.723891 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 536/1076] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:41.729113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feff48-00fa-45ea-9cc8-3c718a1ee891 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:41.729527 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feff48-00fa-45ea-9cc8-3c718a1ee891 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:41.729796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feff48-00fa-45ea-9cc8-3c718a1ee891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:41.747453 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-15feff48-00fa-45ea-9cc8-3c718a1ee891 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:41.748622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-15feff48-00fa-45ea-9cc8-3c718a1ee891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:41.804713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 541/1077] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:41.828000 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253beff-27d7-4729-a764-1b3908b5012e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:41.839933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253beff-27d7-4729-a764-1b3908b5012e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:41.844736 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ff6c0-e2a2-4cba-9e08-a30ee9eae4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:41.845511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ff6c0-e2a2-4cba-9e08-a30ee9eae4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:41.845790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ff6c0-e2a2-4cba-9e08-a30ee9eae4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:41.846061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ff6c0-e2a2-4cba-9e08-a30ee9eae4e2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:41.854136 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15510ed-25c7-4a4f-96e2-c44acd1c7bc4 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:41.854456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15510ed-25c7-4a4f-96e2-c44acd1c7bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:41.854734 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15510ed-25c7-4a4f-96e2-c44acd1c7bc4 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:41.856507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 542/1078] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:26:41.856738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ff6c0-e2a2-4cba-9e08-a30ee9eae4e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:41.861417 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb794dd2-8dc0-4ea8-926d-b85a6241e4fb None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:41.861700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb794dd2-8dc0-4ea8-926d-b85a6241e4fb None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:41.861975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb794dd2-8dc0-4ea8-926d-b85a6241e4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:41.863530 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-fa6ff6c0-e2a2-4cba-9e08-a30ee9eae4e2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:26:41.864795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 537/1079] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:41.870551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ff6c0-e2a2-4cba-9e08-a30ee9eae4e2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:41.880615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ff6c0-e2a2-4cba-9e08-a30ee9eae4e2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:41.880832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-cb794dd2-8dc0-4ea8-926d-b85a6241e4fb None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:41.881887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-cb794dd2-8dc0-4ea8-926d-b85a6241e4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:41.885120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cee8f-ba0c-4dd1-8e87-4078da9da170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:41.885756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cee8f-ba0c-4dd1-8e87-4078da9da170 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:41.886038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cee8f-ba0c-4dd1-8e87-4078da9da170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:41.886350 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cee8f-ba0c-4dd1-8e87-4078da9da170 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:41.887097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cee8f-ba0c-4dd1-8e87-4078da9da170 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:41.887406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cee8f-ba0c-4dd1-8e87-4078da9da170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:41.889531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cee8f-ba0c-4dd1-8e87-4078da9da170 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:41.890049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 543/1080] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:41.897811 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 538/1081] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:26:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:41.903134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb794dd2-8dc0-4ea8-926d-b85a6241e4fb None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:41.912075 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb794dd2-8dc0-4ea8-926d-b85a6241e4fb None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:41.913444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cee8f-ba0c-4dd1-8e87-4078da9da170 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:41.917310 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a61a3d-5693-4007-9055-d47c2146cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:41.918160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a61a3d-5693-4007-9055-d47c2146cd54 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:41.918478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a61a3d-5693-4007-9055-d47c2146cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:41.918752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a61a3d-5693-4007-9055-d47c2146cd54 admin admin] PATH_INFO: `/v3/users/e6f117484e9441bfbc013e485a1038db` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:41.919945 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a61a3d-5693-4007-9055-d47c2146cd54 admin admin] RBAC: Authorizing `identity:get_user(user_id=e6f117484e9441bfbc013e485a1038db)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:41.922058 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a61a3d-5693-4007-9055-d47c2146cd54 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:41.922626 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cee8f-ba0c-4dd1-8e87-4078da9da170 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:41.927113 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896684be-9c7d-4d88-a7af-e44b75ce01b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:41.927893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896684be-9c7d-4d88-a7af-e44b75ce01b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:41.928166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896684be-9c7d-4d88-a7af-e44b75ce01b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:41.928432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896684be-9c7d-4d88-a7af-e44b75ce01b7 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:41.931182 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 544/1082] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:26:41 2022] GET /identity/v3/users/e6f117484e9441bfbc013e485a1038db => generated 285 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:41.937249 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a61a3d-5693-4007-9055-d47c2146cd54 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:41.942563 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896684be-9c7d-4d88-a7af-e44b75ce01b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:41.946408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a61a3d-5693-4007-9055-d47c2146cd54 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:41.949798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-896684be-9c7d-4d88-a7af-e44b75ce01b7 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 01:26:41.951318 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6c4ca-2829-4eca-b45e-4eeb0f972a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:41.951769 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 539/1083] 10.222.0.79 () {56 vars in 1141 bytes} [Mon Feb 21 01:26:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:26:41.952112 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6c4ca-2829-4eca-b45e-4eeb0f972a7a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:41.952389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6c4ca-2829-4eca-b45e-4eeb0f972a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:41.952661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6c4ca-2829-4eca-b45e-4eeb0f972a7a admin admin] PATH_INFO: `/v3/projects/ba6b5e4f592240928c05444f6c31cea0` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:41.953795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6c4ca-2829-4eca-b45e-4eeb0f972a7a admin admin] RBAC: Authorizing `identity:get_project(project_id=ba6b5e4f592240928c05444f6c31cea0)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:41.955828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6c4ca-2829-4eca-b45e-4eeb0f972a7a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:41.957403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896684be-9c7d-4d88-a7af-e44b75ce01b7 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:41.957574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 545/1084] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:26:41 2022] GET /identity/v3/projects/ba6b5e4f592240928c05444f6c31cea0 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:41.962905 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6c4ca-2829-4eca-b45e-4eeb0f972a7a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:41.967548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896684be-9c7d-4d88-a7af-e44b75ce01b7 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:41.971952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6c4ca-2829-4eca-b45e-4eeb0f972a7a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:41.972068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56134df-427d-4b2b-8303-f9278f5c8379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:41.972694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56134df-427d-4b2b-8303-f9278f5c8379 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:41.973086 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56134df-427d-4b2b-8303-f9278f5c8379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:41.973365 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56134df-427d-4b2b-8303-f9278f5c8379 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:41.974099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56134df-427d-4b2b-8303-f9278f5c8379 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:41.974433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56134df-427d-4b2b-8303-f9278f5c8379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:41.976013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56134df-427d-4b2b-8303-f9278f5c8379 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:41.976351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d94f7b-81b9-4624-b44f-ba5e4ee5d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:41.977172 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d94f7b-81b9-4624-b44f-ba5e4ee5d801 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:41.977454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d94f7b-81b9-4624-b44f-ba5e4ee5d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:41.977728 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d94f7b-81b9-4624-b44f-ba5e4ee5d801 admin admin] PATH_INFO: `/v3/projects/ba6b5e4f592240928c05444f6c31cea0/users/e6f117484e9441bfbc013e485a1038db/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:41.979679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d94f7b-81b9-4624-b44f-ba5e4ee5d801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6b5e4f592240928c05444f6c31cea0, user_id=e6f117484e9441bfbc013e485a1038db, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:41.982298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d94f7b-81b9-4624-b44f-ba5e4ee5d801 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:41.983898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 540/1085] 10.222.0.79 () {56 vars in 1136 bytes} [Mon Feb 21 01:26:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:41.989519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56134df-427d-4b2b-8303-f9278f5c8379 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:41.996231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 546/1086] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:26:41 2022] PUT /identity/v3/projects/ba6b5e4f592240928c05444f6c31cea0/users/e6f117484e9441bfbc013e485a1038db/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:26:41.999532 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56134df-427d-4b2b-8303-f9278f5c8379 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:42.056712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebe7eb-7279-492c-b211-106a142b1934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:42.057530 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebe7eb-7279-492c-b211-106a142b1934 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.057816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebe7eb-7279-492c-b211-106a142b1934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.058093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebe7eb-7279-492c-b211-106a142b1934 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.069479 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebe7eb-7279-492c-b211-106a142b1934 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:42.071380 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebe7eb-7279-492c-b211-106a142b1934 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:42.090472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-71ebe7eb-7279-492c-b211-106a142b1934 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:42.093210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 541/1087] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:42.096926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d94f7b-81b9-4624-b44f-ba5e4ee5d801 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:42.107229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d94f7b-81b9-4624-b44f-ba5e4ee5d801 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:42.111815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e73830-8892-42a1-9a1d-b32d5412f0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:42.112486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e73830-8892-42a1-9a1d-b32d5412f0db admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.112770 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e73830-8892-42a1-9a1d-b32d5412f0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.113040 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e73830-8892-42a1-9a1d-b32d5412f0db admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.113776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e73830-8892-42a1-9a1d-b32d5412f0db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:42.114084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e73830-8892-42a1-9a1d-b32d5412f0db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:42.115790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e73830-8892-42a1-9a1d-b32d5412f0db admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:42.129302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 547/1088] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:42.135194 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebe7eb-7279-492c-b211-106a142b1934 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:42.145986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebe7eb-7279-492c-b211-106a142b1934 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:42.150748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf9e7b-082c-4446-8d8f-732358ddb03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:42.151634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9e7b-082c-4446-8d8f-732358ddb03b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.151986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9e7b-082c-4446-8d8f-732358ddb03b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.152329 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9e7b-082c-4446-8d8f-732358ddb03b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.160546 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf9e7b-082c-4446-8d8f-732358ddb03b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:42.162745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf9e7b-082c-4446-8d8f-732358ddb03b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:42.177593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-2fdf9e7b-082c-4446-8d8f-732358ddb03b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:26:42.178819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 542/1089] 10.222.0.79 () {56 vars in 1114 bytes} [Mon Feb 21 01:26:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:42.186414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e73830-8892-42a1-9a1d-b32d5412f0db admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:42.199082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e73830-8892-42a1-9a1d-b32d5412f0db admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:42.204142 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049f9c5-49ac-4319-b198-c319a4a62761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:42.204794 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049f9c5-49ac-4319-b198-c319a4a62761 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.205074 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049f9c5-49ac-4319-b198-c319a4a62761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.205341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049f9c5-49ac-4319-b198-c319a4a62761 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.206166 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049f9c5-49ac-4319-b198-c319a4a62761 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:42.206505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049f9c5-49ac-4319-b198-c319a4a62761 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:42.208320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049f9c5-49ac-4319-b198-c319a4a62761 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:42.225370 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 548/1090] 10.222.0.79 () {56 vars in 1154 bytes} [Mon Feb 21 01:26:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:42.232269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf9e7b-082c-4446-8d8f-732358ddb03b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:42.241679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf9e7b-082c-4446-8d8f-732358ddb03b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:42.246074 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccd714-6cd3-4eeb-83ec-147db8673a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:42.246789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccd714-6cd3-4eeb-83ec-147db8673a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.247575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccd714-6cd3-4eeb-83ec-147db8673a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.247851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccd714-6cd3-4eeb-83ec-147db8673a1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.255653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccd714-6cd3-4eeb-83ec-147db8673a1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:42.257383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccd714-6cd3-4eeb-83ec-147db8673a1c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:42.265974 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 543/1091] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:42 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:42.271558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049f9c5-49ac-4319-b198-c319a4a62761 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:42.281043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049f9c5-49ac-4319-b198-c319a4a62761 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:42.285464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0a21-3e67-4b44-b6ed-27a73e10c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:42.286258 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0a21-3e67-4b44-b6ed-27a73e10c309 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.286544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0a21-3e67-4b44-b6ed-27a73e10c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.286818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0a21-3e67-4b44-b6ed-27a73e10c309 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.297327 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef0a21-3e67-4b44-b6ed-27a73e10c309 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:42.299176 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef0a21-3e67-4b44-b6ed-27a73e10c309 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:42.315808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-d2ef0a21-3e67-4b44-b6ed-27a73e10c309 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:26:42.316961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 549/1092] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:42.322705 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccd714-6cd3-4eeb-83ec-147db8673a1c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:42.331429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccd714-6cd3-4eeb-83ec-147db8673a1c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:42.335950 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64829fa-72ab-4711-b5c0-869ae304bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:42.336592 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64829fa-72ab-4711-b5c0-869ae304bf74 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.336872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64829fa-72ab-4711-b5c0-869ae304bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.337143 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64829fa-72ab-4711-b5c0-869ae304bf74 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.337854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64829fa-72ab-4711-b5c0-869ae304bf74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:42.338157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64829fa-72ab-4711-b5c0-869ae304bf74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:42.339756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64829fa-72ab-4711-b5c0-869ae304bf74 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:42.350730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 544/1093] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:42.356791 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0a21-3e67-4b44-b6ed-27a73e10c309 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:42.366286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0a21-3e67-4b44-b6ed-27a73e10c309 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:42.370682 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eded19-d453-4382-8315-f1b93f149268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:42.371440 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eded19-d453-4382-8315-f1b93f149268 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.371718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eded19-d453-4382-8315-f1b93f149268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.372617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eded19-d453-4382-8315-f1b93f149268 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.379849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eded19-d453-4382-8315-f1b93f149268 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:42.381788 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eded19-d453-4382-8315-f1b93f149268 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:42.394194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-d9eded19-d453-4382-8315-f1b93f149268 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:26:42.395388 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 550/1094] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:42.401344 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64829fa-72ab-4711-b5c0-869ae304bf74 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:42.410873 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64829fa-72ab-4711-b5c0-869ae304bf74 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:42.415360 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5506792-055e-461d-a0c1-989d26279740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:42.415997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5506792-055e-461d-a0c1-989d26279740 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.416279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5506792-055e-461d-a0c1-989d26279740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.416548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5506792-055e-461d-a0c1-989d26279740 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.417322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5506792-055e-461d-a0c1-989d26279740 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:42.417622 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5506792-055e-461d-a0c1-989d26279740 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:42.420420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5506792-055e-461d-a0c1-989d26279740 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:42.433074 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 545/1095] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:26:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:42.440150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eded19-d453-4382-8315-f1b93f149268 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:42.450359 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eded19-d453-4382-8315-f1b93f149268 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:42.454869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721b1c7-9806-47cb-8b67-d7bcf1eafef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:42.455491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b1c7-9806-47cb-8b67-d7bcf1eafef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.455769 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b1c7-9806-47cb-8b67-d7bcf1eafef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.456042 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b1c7-9806-47cb-8b67-d7bcf1eafef4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.456857 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721b1c7-9806-47cb-8b67-d7bcf1eafef4 admin admin] RBAC: Adding query filter params (role.id=e0a1a99f5c794f5db82f71def072c7c9, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=333ec5b3842b432a99bc265abbe7fa58) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:42.457170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721b1c7-9806-47cb-8b67-d7bcf1eafef4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:42.459028 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721b1c7-9806-47cb-8b67-d7bcf1eafef4 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:42.464777 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 551/1096] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:42 2022] GET /identity/v3/role_assignments?user.id=333ec5b3842b432a99bc265abbe7fa58&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=e0a1a99f5c794f5db82f71def072c7c9 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:44.283273 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe4887-11d0-4180-815a-4adf3d6101df None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:44.283805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe4887-11d0-4180-815a-4adf3d6101df None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:44.283805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe4887-11d0-4180-815a-4adf3d6101df None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:44.285571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 546/1097] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:44.290812 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33e56f-bccc-4ecb-b691-cc3ed3c12831 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:44.291260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33e56f-bccc-4ecb-b691-cc3ed3c12831 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:44.291371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33e56f-bccc-4ecb-b691-cc3ed3c12831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:44.309014 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-0a33e56f-bccc-4ecb-b691-cc3ed3c12831 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:44.310748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0a33e56f-bccc-4ecb-b691-cc3ed3c12831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:44.318360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 552/1098] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:44.342356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe4887-11d0-4180-815a-4adf3d6101df None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:44.354155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe4887-11d0-4180-815a-4adf3d6101df None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:44.358476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2600e-aac6-47e6-9c86-6435848f1352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:44.359242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2600e-aac6-47e6-9c86-6435848f1352 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:44.359519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2600e-aac6-47e6-9c86-6435848f1352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:44.359792 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2600e-aac6-47e6-9c86-6435848f1352 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:44.369415 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2600e-aac6-47e6-9c86-6435848f1352 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:26:44.376893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-66d2600e-aac6-47e6-9c86-6435848f1352 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:26:44.377999 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 547/1099] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:26:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:26:44.383717 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33e56f-bccc-4ecb-b691-cc3ed3c12831 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:44.393156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33e56f-bccc-4ecb-b691-cc3ed3c12831 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:44.397538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91e4a5-2d6b-4b89-88d7-ed23a4964008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:44.398175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91e4a5-2d6b-4b89-88d7-ed23a4964008 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:44.398480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91e4a5-2d6b-4b89-88d7-ed23a4964008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:44.398746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91e4a5-2d6b-4b89-88d7-ed23a4964008 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:44.399479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91e4a5-2d6b-4b89-88d7-ed23a4964008 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:44.399779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91e4a5-2d6b-4b89-88d7-ed23a4964008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:44.401357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91e4a5-2d6b-4b89-88d7-ed23a4964008 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:44.411149 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 553/1100] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:26:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:44.416715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2600e-aac6-47e6-9c86-6435848f1352 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:44.426081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2600e-aac6-47e6-9c86-6435848f1352 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:44.430519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f37b95-8523-4b5c-83ba-8ff142e660fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:44.431347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f37b95-8523-4b5c-83ba-8ff142e660fd admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:44.431625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f37b95-8523-4b5c-83ba-8ff142e660fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:44.431896 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f37b95-8523-4b5c-83ba-8ff142e660fd admin admin] PATH_INFO: `/v3/users/e6f117484e9441bfbc013e485a1038db` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:44.433060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f37b95-8523-4b5c-83ba-8ff142e660fd admin admin] RBAC: Authorizing `identity:get_user(user_id=e6f117484e9441bfbc013e485a1038db)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:44.435730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f37b95-8523-4b5c-83ba-8ff142e660fd admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:44.437254 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 548/1101] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:26:44 2022] GET /identity/v3/users/e6f117484e9441bfbc013e485a1038db => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:44.442461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91e4a5-2d6b-4b89-88d7-ed23a4964008 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:44.452204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91e4a5-2d6b-4b89-88d7-ed23a4964008 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:44.456630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02720f2-d756-4beb-8c79-fb772fa41aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:44.457231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02720f2-d756-4beb-8c79-fb772fa41aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:44.457506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02720f2-d756-4beb-8c79-fb772fa41aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:44.457772 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02720f2-d756-4beb-8c79-fb772fa41aa0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:44.465193 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02720f2-d756-4beb-8c79-fb772fa41aa0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:44.467047 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02720f2-d756-4beb-8c79-fb772fa41aa0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:44.475477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 554/1102] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:44 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:44.480750 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f37b95-8523-4b5c-83ba-8ff142e660fd admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:44.490878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f37b95-8523-4b5c-83ba-8ff142e660fd admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:44.495271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882a22d-3f3f-4ca3-b8e2-ec3d56c7feb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:44.496061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a22d-3f3f-4ca3-b8e2-ec3d56c7feb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:44.496337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a22d-3f3f-4ca3-b8e2-ec3d56c7feb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:44.496606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a22d-3f3f-4ca3-b8e2-ec3d56c7feb9 admin admin] PATH_INFO: `/v3/projects/ba6b5e4f592240928c05444f6c31cea0` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:44.498387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882a22d-3f3f-4ca3-b8e2-ec3d56c7feb9 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba6b5e4f592240928c05444f6c31cea0)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:44.500628 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882a22d-3f3f-4ca3-b8e2-ec3d56c7feb9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:44.502263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 549/1103] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:26:44 2022] GET /identity/v3/projects/ba6b5e4f592240928c05444f6c31cea0 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:44.507440 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02720f2-d756-4beb-8c79-fb772fa41aa0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:44.515609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02720f2-d756-4beb-8c79-fb772fa41aa0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:44.520007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de3e36-d459-4846-a299-6346c8f915ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:44.520594 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de3e36-d459-4846-a299-6346c8f915ae admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:44.520873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de3e36-d459-4846-a299-6346c8f915ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:44.521141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de3e36-d459-4846-a299-6346c8f915ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:44.521945 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de3e36-d459-4846-a299-6346c8f915ae admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=ba6b5e4f592240928c05444f6c31cea0, user.id=e6f117484e9441bfbc013e485a1038db) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:44.522273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de3e36-d459-4846-a299-6346c8f915ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:44.524038 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de3e36-d459-4846-a299-6346c8f915ae admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:44.529561 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 555/1104] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:44 2022] GET /identity/v3/role_assignments?user.id=e6f117484e9441bfbc013e485a1038db&scope.project.id=ba6b5e4f592240928c05444f6c31cea0&role.id=548abad662724741a3261205ee7cb828 => generated 608 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:26:46.840949 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d4a0f-a9c5-4d6a-905e-aca710a02750 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:46.841512 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d4a0f-a9c5-4d6a-905e-aca710a02750 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:46.841512 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d4a0f-a9c5-4d6a-905e-aca710a02750 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:46.843287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 550/1105] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:46.848446 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708bd36-ca57-4243-b052-c0ff276e5ed9 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:46.848809 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708bd36-ca57-4243-b052-c0ff276e5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:46.848996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708bd36-ca57-4243-b052-c0ff276e5ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:46.866816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-e708bd36-ca57-4243-b052-c0ff276e5ed9 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:46.867986 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e708bd36-ca57-4243-b052-c0ff276e5ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:46.876494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 556/1106] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:46.900562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d4a0f-a9c5-4d6a-905e-aca710a02750 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:46.912240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d4a0f-a9c5-4d6a-905e-aca710a02750 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:46.916478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442c6bc-5ec2-4c9e-a63f-2b751fba7aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:46.917237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442c6bc-5ec2-4c9e-a63f-2b751fba7aff admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:46.917516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442c6bc-5ec2-4c9e-a63f-2b751fba7aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:46.917789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442c6bc-5ec2-4c9e-a63f-2b751fba7aff admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:46.919476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442c6bc-5ec2-4c9e-a63f-2b751fba7aff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:46.921143 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442c6bc-5ec2-4c9e-a63f-2b751fba7aff admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:46.922695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 551/1107] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:46.927883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708bd36-ca57-4243-b052-c0ff276e5ed9 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:46.937103 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708bd36-ca57-4243-b052-c0ff276e5ed9 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:46.941575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb3292-d3f0-47e1-a68c-f617671f98f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:46.942229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb3292-d3f0-47e1-a68c-f617671f98f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:46.942531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb3292-d3f0-47e1-a68c-f617671f98f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:46.942807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb3292-d3f0-47e1-a68c-f617671f98f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:46.943500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb3292-d3f0-47e1-a68c-f617671f98f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:46.945399 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb3292-d3f0-47e1-a68c-f617671f98f1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:46.963964 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 557/1108] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:26:46 2022] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:49.272921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495892c5-0863-4fb4-b6f6-3de2a797447d None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:49.273468 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495892c5-0863-4fb4-b6f6-3de2a797447d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:49.273468 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495892c5-0863-4fb4-b6f6-3de2a797447d None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:49.275235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 552/1109] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:49.281084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a4155-a9ca-4c58-b28c-4d94e4760e24 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:49.281459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a4155-a9ca-4c58-b28c-4d94e4760e24 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:49.281621 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a4155-a9ca-4c58-b28c-4d94e4760e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:49.298674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-4d6a4155-a9ca-4c58-b28c-4d94e4760e24 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:49.299829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-4d6a4155-a9ca-4c58-b28c-4d94e4760e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:49.307159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 558/1110] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:49.330909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495892c5-0863-4fb4-b6f6-3de2a797447d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:49.343117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495892c5-0863-4fb4-b6f6-3de2a797447d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:49.347329 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67955f9-b269-49ee-8bf8-f27ca66c128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:49.348149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67955f9-b269-49ee-8bf8-f27ca66c128e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:49.348428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67955f9-b269-49ee-8bf8-f27ca66c128e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:49.348698 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67955f9-b269-49ee-8bf8-f27ca66c128e admin admin] PATH_INFO: `/v3/roles/289d1250826d4384990c8f3d403bc047` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:49.350131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67955f9-b269-49ee-8bf8-f27ca66c128e admin admin] RBAC: Authorizing `identity:get_role(role_id=289d1250826d4384990c8f3d403bc047)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:49.351156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-c67955f9-b269-49ee-8bf8-f27ca66c128e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:26:49.351156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:26:49.351156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:26:49.352010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67955f9-b269-49ee-8bf8-f27ca66c128e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:49.353286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 553/1111] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:26:49 2022] GET /identity/v3/roles/289d1250826d4384990c8f3d403bc047 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:49.358624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a4155-a9ca-4c58-b28c-4d94e4760e24 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:49.367169 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a4155-a9ca-4c58-b28c-4d94e4760e24 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:49.372127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b358484-c878-422a-b795-4606c146ac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:49.372948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b358484-c878-422a-b795-4606c146ac1f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:49.373225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b358484-c878-422a-b795-4606c146ac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:49.373494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b358484-c878-422a-b795-4606c146ac1f admin admin] PATH_INFO: `/v3/users/8b1b28d1553340878cb5a302e778837a` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:49.386597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b358484-c878-422a-b795-4606c146ac1f admin admin] RBAC: Authorizing `identity:get_user(user_id=8b1b28d1553340878cb5a302e778837a)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:49.389336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b358484-c878-422a-b795-4606c146ac1f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:49.390940 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 559/1112] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:26:49 2022] GET /identity/v3/users/8b1b28d1553340878cb5a302e778837a => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:49.396215 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67955f9-b269-49ee-8bf8-f27ca66c128e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:49.405244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67955f9-b269-49ee-8bf8-f27ca66c128e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:49.409568 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd8f16-0706-418d-8e2e-f083463a14f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:49.410170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd8f16-0706-418d-8e2e-f083463a14f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:49.410474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd8f16-0706-418d-8e2e-f083463a14f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:49.410745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd8f16-0706-418d-8e2e-f083463a14f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:49.418058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd8f16-0706-418d-8e2e-f083463a14f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:49.419778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd8f16-0706-418d-8e2e-f083463a14f7 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:49.428146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 554/1113] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:49 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:49.433371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b358484-c878-422a-b795-4606c146ac1f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:49.443045 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b358484-c878-422a-b795-4606c146ac1f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:49.447510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d6367-92d4-458e-92be-569d01ac1769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:49.448324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d6367-92d4-458e-92be-569d01ac1769 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:49.448607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d6367-92d4-458e-92be-569d01ac1769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:49.448882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d6367-92d4-458e-92be-569d01ac1769 admin admin] PATH_INFO: `/v3/projects/ba6b5e4f592240928c05444f6c31cea0` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:49.450685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d6367-92d4-458e-92be-569d01ac1769 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba6b5e4f592240928c05444f6c31cea0)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:49.452674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d6367-92d4-458e-92be-569d01ac1769 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:49.454290 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 560/1114] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:26:49 2022] GET /identity/v3/projects/ba6b5e4f592240928c05444f6c31cea0 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:49.459753 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd8f16-0706-418d-8e2e-f083463a14f7 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:49.467980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd8f16-0706-418d-8e2e-f083463a14f7 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:49.472362 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4a39a-c5e7-4bde-9faa-5e5e1d0856f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:49.472960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4a39a-c5e7-4bde-9faa-5e5e1d0856f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:49.473236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4a39a-c5e7-4bde-9faa-5e5e1d0856f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:49.473502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4a39a-c5e7-4bde-9faa-5e5e1d0856f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:49.474354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4a39a-c5e7-4bde-9faa-5e5e1d0856f5 admin admin] RBAC: Adding query filter params (role.id=289d1250826d4384990c8f3d403bc047, scope.project.id=ba6b5e4f592240928c05444f6c31cea0, user.id=8b1b28d1553340878cb5a302e778837a) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:49.474658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4a39a-c5e7-4bde-9faa-5e5e1d0856f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:49.476414 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4a39a-c5e7-4bde-9faa-5e5e1d0856f5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:49.481482 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 555/1115] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:49 2022] GET /identity/v3/role_assignments?user.id=8b1b28d1553340878cb5a302e778837a&scope.project.id=ba6b5e4f592240928c05444f6c31cea0&role.id=289d1250826d4384990c8f3d403bc047 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:51.709113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f99515-eaf0-4896-8866-766461c7a94b None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:51.709684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f99515-eaf0-4896-8866-766461c7a94b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:51.709684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f99515-eaf0-4896-8866-766461c7a94b None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:51.711441 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 561/1116] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:51.717041 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c3f1d-fe10-44fc-ab37-5b245f3b7f5a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:51.717483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c3f1d-fe10-44fc-ab37-5b245f3b7f5a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:51.717575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c3f1d-fe10-44fc-ab37-5b245f3b7f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:51.735350 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-bc7c3f1d-fe10-44fc-ab37-5b245f3b7f5a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:51.736514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-bc7c3f1d-fe10-44fc-ab37-5b245f3b7f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:51.744005 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 556/1117] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:51.766455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f99515-eaf0-4896-8866-766461c7a94b None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:51.778679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f99515-eaf0-4896-8866-766461c7a94b None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:51.782897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ebe89-2bbb-43cd-aa2f-474f5b900297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:51.783706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ebe89-2bbb-43cd-aa2f-474f5b900297 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:51.783981 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ebe89-2bbb-43cd-aa2f-474f5b900297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:51.784247 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ebe89-2bbb-43cd-aa2f-474f5b900297 admin admin] PATH_INFO: `/v3/roles/289d1250826d4384990c8f3d403bc047` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:51.785658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ebe89-2bbb-43cd-aa2f-474f5b900297 admin admin] RBAC: Authorizing `identity:get_role(role_id=289d1250826d4384990c8f3d403bc047)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:51.786685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-ba6ebe89-2bbb-43cd-aa2f-474f5b900297 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:26:51.786685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:26:51.786685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:26:51.787544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ebe89-2bbb-43cd-aa2f-474f5b900297 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:51.788833 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 562/1118] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:26:51 2022] GET /identity/v3/roles/289d1250826d4384990c8f3d403bc047 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:51.794726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c3f1d-fe10-44fc-ab37-5b245f3b7f5a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:51.803219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c3f1d-fe10-44fc-ab37-5b245f3b7f5a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:51.807664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb080e76-dade-491d-9a4e-b91cf083a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:51.808500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb080e76-dade-491d-9a4e-b91cf083a3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:51.808778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb080e76-dade-491d-9a4e-b91cf083a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:51.809095 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb080e76-dade-491d-9a4e-b91cf083a3a8 admin admin] PATH_INFO: `/v3/users/8b1b28d1553340878cb5a302e778837a` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:51.810301 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb080e76-dade-491d-9a4e-b91cf083a3a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b1b28d1553340878cb5a302e778837a)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:51.812392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb080e76-dade-491d-9a4e-b91cf083a3a8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:51.813915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 557/1119] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:26:51 2022] GET /identity/v3/users/8b1b28d1553340878cb5a302e778837a => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:51.819131 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ebe89-2bbb-43cd-aa2f-474f5b900297 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:51.828303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ebe89-2bbb-43cd-aa2f-474f5b900297 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:51.832738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa9a18-d035-499f-8a33-e18e265fe2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:51.833530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9a18-d035-499f-8a33-e18e265fe2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:51.833813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9a18-d035-499f-8a33-e18e265fe2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:51.834088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9a18-d035-499f-8a33-e18e265fe2f6 admin admin] PATH_INFO: `/v3/projects/ba6b5e4f592240928c05444f6c31cea0` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:51.835276 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa9a18-d035-499f-8a33-e18e265fe2f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba6b5e4f592240928c05444f6c31cea0)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:51.837253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa9a18-d035-499f-8a33-e18e265fe2f6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:51.838886 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 563/1120] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:26:51 2022] GET /identity/v3/projects/ba6b5e4f592240928c05444f6c31cea0 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:51.845150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb080e76-dade-491d-9a4e-b91cf083a3a8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:51.855351 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb080e76-dade-491d-9a4e-b91cf083a3a8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:51.860454 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad0106-14d9-4c52-8d5c-c47ca3bc10a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:51.861300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad0106-14d9-4c52-8d5c-c47ca3bc10a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:51.861583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad0106-14d9-4c52-8d5c-c47ca3bc10a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:51.861860 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad0106-14d9-4c52-8d5c-c47ca3bc10a6 admin admin] PATH_INFO: `/v3/projects/ba6b5e4f592240928c05444f6c31cea0/users/8b1b28d1553340878cb5a302e778837a/roles/289d1250826d4384990c8f3d403bc047` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:51.864074 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad0106-14d9-4c52-8d5c-c47ca3bc10a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6b5e4f592240928c05444f6c31cea0, user_id=8b1b28d1553340878cb5a302e778837a, role_id=289d1250826d4384990c8f3d403bc047)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:51.866713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad0106-14d9-4c52-8d5c-c47ca3bc10a6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:51.879256 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 558/1121] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:26:51 2022] PUT /identity/v3/projects/ba6b5e4f592240928c05444f6c31cea0/users/8b1b28d1553340878cb5a302e778837a/roles/289d1250826d4384990c8f3d403bc047 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:26:54.108643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8d7be-30d7-4a82-bb7a-e1f1d7c5d4cc None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:54.109073 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8d7be-30d7-4a82-bb7a-e1f1d7c5d4cc None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:54.109204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8d7be-30d7-4a82-bb7a-e1f1d7c5d4cc None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:54.111034 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 564/1122] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:54.116259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dfe90-0fc2-4e8b-bf07-00ebe2be7802 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:54.116686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dfe90-0fc2-4e8b-bf07-00ebe2be7802 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:54.116812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dfe90-0fc2-4e8b-bf07-00ebe2be7802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:54.134392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-805dfe90-0fc2-4e8b-bf07-00ebe2be7802 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:54.135569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-805dfe90-0fc2-4e8b-bf07-00ebe2be7802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:54.190281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 559/1123] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:54.213561 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8d7be-30d7-4a82-bb7a-e1f1d7c5d4cc None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:54.225927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8d7be-30d7-4a82-bb7a-e1f1d7c5d4cc None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:54.230251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8a789-79b1-41a3-b2eb-96ddafe4b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:54.231685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8a789-79b1-41a3-b2eb-96ddafe4b1fc admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:54.231966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8a789-79b1-41a3-b2eb-96ddafe4b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:54.232240 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8a789-79b1-41a3-b2eb-96ddafe4b1fc admin admin] PATH_INFO: `/v3/roles/289d1250826d4384990c8f3d403bc047` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:54.233692 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8a789-79b1-41a3-b2eb-96ddafe4b1fc admin admin] RBAC: Authorizing `identity:get_role(role_id=289d1250826d4384990c8f3d403bc047)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:54.235309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8a789-79b1-41a3-b2eb-96ddafe4b1fc admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:54.236614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 565/1124] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:26:54 2022] GET /identity/v3/roles/289d1250826d4384990c8f3d403bc047 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:54.241867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dfe90-0fc2-4e8b-bf07-00ebe2be7802 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:54.250658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dfe90-0fc2-4e8b-bf07-00ebe2be7802 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:54.255078 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeae33-9e03-4fca-a625-de6dc1d18531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:54.255918 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeae33-9e03-4fca-a625-de6dc1d18531 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:54.256198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeae33-9e03-4fca-a625-de6dc1d18531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:54.256471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeae33-9e03-4fca-a625-de6dc1d18531 admin admin] PATH_INFO: `/v3/users/8b1b28d1553340878cb5a302e778837a` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:54.257658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeae33-9e03-4fca-a625-de6dc1d18531 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b1b28d1553340878cb5a302e778837a)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:54.259808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeae33-9e03-4fca-a625-de6dc1d18531 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:54.261349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 560/1125] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:26:54 2022] GET /identity/v3/users/8b1b28d1553340878cb5a302e778837a => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:54.267055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8a789-79b1-41a3-b2eb-96ddafe4b1fc admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:54.276154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8a789-79b1-41a3-b2eb-96ddafe4b1fc admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:54.281209 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a805ed-b097-4467-b2a9-976486a1b13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:54.281800 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a805ed-b097-4467-b2a9-976486a1b13c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:54.282080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a805ed-b097-4467-b2a9-976486a1b13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:54.282395 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a805ed-b097-4467-b2a9-976486a1b13c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:54.289748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a805ed-b097-4467-b2a9-976486a1b13c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:54.291449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a805ed-b097-4467-b2a9-976486a1b13c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:54.299875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 566/1126] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:26:54 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:26:54.305067 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeae33-9e03-4fca-a625-de6dc1d18531 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:54.314053 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeae33-9e03-4fca-a625-de6dc1d18531 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:54.318480 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d686d42-7202-44ac-b8fe-93d69e056b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:54.319268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d686d42-7202-44ac-b8fe-93d69e056b48 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:54.319549 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d686d42-7202-44ac-b8fe-93d69e056b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:54.319823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d686d42-7202-44ac-b8fe-93d69e056b48 admin admin] PATH_INFO: `/v3/projects/ba6b5e4f592240928c05444f6c31cea0` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:54.320952 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d686d42-7202-44ac-b8fe-93d69e056b48 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba6b5e4f592240928c05444f6c31cea0)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:54.322970 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d686d42-7202-44ac-b8fe-93d69e056b48 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:54.325045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 561/1127] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:26:54 2022] GET /identity/v3/projects/ba6b5e4f592240928c05444f6c31cea0 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:54.330350 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a805ed-b097-4467-b2a9-976486a1b13c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:54.338519 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a805ed-b097-4467-b2a9-976486a1b13c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:54.343641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b84cbe-6830-493f-9ae6-2cc10c273f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:54.344180 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b84cbe-6830-493f-9ae6-2cc10c273f0c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:54.344457 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b84cbe-6830-493f-9ae6-2cc10c273f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:54.344725 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b84cbe-6830-493f-9ae6-2cc10c273f0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:54.345520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b84cbe-6830-493f-9ae6-2cc10c273f0c admin admin] RBAC: Adding query filter params (role.id=289d1250826d4384990c8f3d403bc047, scope.project.id=ba6b5e4f592240928c05444f6c31cea0, user.id=8b1b28d1553340878cb5a302e778837a) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:26:54.345818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b84cbe-6830-493f-9ae6-2cc10c273f0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:54.347603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b84cbe-6830-493f-9ae6-2cc10c273f0c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:54.353139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 567/1128] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:26:54 2022] GET /identity/v3/role_assignments?user.id=8b1b28d1553340878cb5a302e778837a&scope.project.id=ba6b5e4f592240928c05444f6c31cea0&role.id=289d1250826d4384990c8f3d403bc047 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:56.679653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a010c-df83-4745-8e9b-fb56a7ae187a None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:56.680181 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a010c-df83-4745-8e9b-fb56a7ae187a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:56.680267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a010c-df83-4745-8e9b-fb56a7ae187a None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:56.681968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 562/1129] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:56.687176 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe73cd1-3598-4774-907b-6b0520beed8c None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:56.687574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe73cd1-3598-4774-907b-6b0520beed8c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:56.687725 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe73cd1-3598-4774-907b-6b0520beed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:56.705161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-0fe73cd1-3598-4774-907b-6b0520beed8c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:56.706357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0fe73cd1-3598-4774-907b-6b0520beed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:56.713725 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 568/1130] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:56.736832 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a010c-df83-4745-8e9b-fb56a7ae187a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:56.748702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a010c-df83-4745-8e9b-fb56a7ae187a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:56.753292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a715e-6fc9-4b6c-9f38-c655b2df9873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:56.754052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a715e-6fc9-4b6c-9f38-c655b2df9873 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:56.754370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a715e-6fc9-4b6c-9f38-c655b2df9873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:56.754647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a715e-6fc9-4b6c-9f38-c655b2df9873 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:56.755808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a715e-6fc9-4b6c-9f38-c655b2df9873 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:56.757480 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a715e-6fc9-4b6c-9f38-c655b2df9873 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:56.759045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 563/1131] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:56.764558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe73cd1-3598-4774-907b-6b0520beed8c None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:56.773013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe73cd1-3598-4774-907b-6b0520beed8c None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:56.777388 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d7de4-26a9-4a7c-9032-dd1c9192256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:56.778082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d7de4-26a9-4a7c-9032-dd1c9192256f admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:56.778395 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d7de4-26a9-4a7c-9032-dd1c9192256f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:56.778666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d7de4-26a9-4a7c-9032-dd1c9192256f admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:56.779359 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d7de4-26a9-4a7c-9032-dd1c9192256f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:56.781253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d7de4-26a9-4a7c-9032-dd1c9192256f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:56.805310 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 569/1132] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:26:56 2022] POST /identity/v3/projects => generated 311 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:26:59.131756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0725b0f-653a-44dc-bf0c-14596e749b1c None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:59.132180 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0725b0f-653a-44dc-bf0c-14596e749b1c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:59.132302 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0725b0f-653a-44dc-bf0c-14596e749b1c None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:59.134058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 564/1133] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:59.139261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a57e5-073e-47d9-9e71-50c850f6e84f None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:59.139642 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a57e5-073e-47d9-9e71-50c850f6e84f None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:59.139813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a57e5-073e-47d9-9e71-50c850f6e84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:59.157448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-1c8a57e5-073e-47d9-9e71-50c850f6e84f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:59.158643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1c8a57e5-073e-47d9-9e71-50c850f6e84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:59.212286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 570/1134] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:59.237639 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0725b0f-653a-44dc-bf0c-14596e749b1c None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:59.249646 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0725b0f-653a-44dc-bf0c-14596e749b1c None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:59.253899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f712912-e410-4984-9189-41d1d327098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:59.254710 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f712912-e410-4984-9189-41d1d327098b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:59.254992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f712912-e410-4984-9189-41d1d327098b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:59.255263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f712912-e410-4984-9189-41d1d327098b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:59.256406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f712912-e410-4984-9189-41d1d327098b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:59.258088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f712912-e410-4984-9189-41d1d327098b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:59.259646 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 565/1135] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:26:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:26:59.264855 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a57e5-073e-47d9-9e71-50c850f6e84f None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:59.273338 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a57e5-073e-47d9-9e71-50c850f6e84f None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:59.278227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e211f48-d640-43d8-be7b-4342a078db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:59.278870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e211f48-d640-43d8-be7b-4342a078db17 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:59.279144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e211f48-d640-43d8-be7b-4342a078db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:59.279410 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e211f48-d640-43d8-be7b-4342a078db17 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:59.280109 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e211f48-d640-43d8-be7b-4342a078db17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:59.282089 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e211f48-d640-43d8-be7b-4342a078db17 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:59.301386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 571/1136] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:26:59 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:27:01.622843 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57618e1-f1b2-48c1-8044-81849bd82c10 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:01.623425 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57618e1-f1b2-48c1-8044-81849bd82c10 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:01.623425 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57618e1-f1b2-48c1-8044-81849bd82c10 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:01.625384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 566/1137] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:27:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:27:01.630601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cf9d2-40a0-4a7c-b937-67f19e244d8d None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:01.631013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cf9d2-40a0-4a7c-b937-67f19e244d8d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:01.631172 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cf9d2-40a0-4a7c-b937-67f19e244d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:01.648845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c86cf9d2-40a0-4a7c-b937-67f19e244d8d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:27:01.650005 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c86cf9d2-40a0-4a7c-b937-67f19e244d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:27:01.657416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 572/1138] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:27:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:27:01.680488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57618e1-f1b2-48c1-8044-81849bd82c10 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:01.692815 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57618e1-f1b2-48c1-8044-81849bd82c10 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:01.697087 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d22b5-781d-46d3-93ab-f53b84c7beb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:01.697849 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d22b5-781d-46d3-93ab-f53b84c7beb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:01.698130 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d22b5-781d-46d3-93ab-f53b84c7beb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:01.698432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d22b5-781d-46d3-93ab-f53b84c7beb1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:01.708657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d22b5-781d-46d3-93ab-f53b84c7beb1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:27:01.715960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-268d22b5-781d-46d3-93ab-f53b84c7beb1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:27:01.717070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 567/1139] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:27:01.722527 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cf9d2-40a0-4a7c-b937-67f19e244d8d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:01.731724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cf9d2-40a0-4a7c-b937-67f19e244d8d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:01.736083 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc715f-6f9d-4260-a948-b4b6953c6884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:01.736720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc715f-6f9d-4260-a948-b4b6953c6884 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:01.737032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc715f-6f9d-4260-a948-b4b6953c6884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:01.737307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc715f-6f9d-4260-a948-b4b6953c6884 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:01.738043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc715f-6f9d-4260-a948-b4b6953c6884 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:27:01.738379 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc715f-6f9d-4260-a948-b4b6953c6884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:01.739949 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc715f-6f9d-4260-a948-b4b6953c6884 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:01.747915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 573/1140] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:27:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:01.753676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d22b5-781d-46d3-93ab-f53b84c7beb1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:01.763959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d22b5-781d-46d3-93ab-f53b84c7beb1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:01.768367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddccf26-d0a9-43fc-9abc-df9ad88e909e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:01.769185 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddccf26-d0a9-43fc-9abc-df9ad88e909e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:01.769462 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddccf26-d0a9-43fc-9abc-df9ad88e909e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:01.769728 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddccf26-d0a9-43fc-9abc-df9ad88e909e admin admin] PATH_INFO: `/v3/users/76cd9e2ab50c4409ace63b4ad17deb38` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:01.782649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddccf26-d0a9-43fc-9abc-df9ad88e909e admin admin] RBAC: Authorizing `identity:get_user(user_id=76cd9e2ab50c4409ace63b4ad17deb38)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:01.784754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddccf26-d0a9-43fc-9abc-df9ad88e909e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:01.786324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 568/1141] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:27:01 2022] GET /identity/v3/users/76cd9e2ab50c4409ace63b4ad17deb38 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:01.791663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc715f-6f9d-4260-a948-b4b6953c6884 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:01.800974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc715f-6f9d-4260-a948-b4b6953c6884 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:01.805350 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5f29d-5e64-48c9-b6f8-233e72ce573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:01.805961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5f29d-5e64-48c9-b6f8-233e72ce573b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:01.806267 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5f29d-5e64-48c9-b6f8-233e72ce573b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:01.806542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5f29d-5e64-48c9-b6f8-233e72ce573b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:01.814007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5f29d-5e64-48c9-b6f8-233e72ce573b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:01.815746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5f29d-5e64-48c9-b6f8-233e72ce573b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:01.824810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 574/1142] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:27:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:27:01.830247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddccf26-d0a9-43fc-9abc-df9ad88e909e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:01.839309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddccf26-d0a9-43fc-9abc-df9ad88e909e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:01.844299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c62ce1-0a1b-4bc3-9bda-5495f7099adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:01.845109 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c62ce1-0a1b-4bc3-9bda-5495f7099adc admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:01.845388 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c62ce1-0a1b-4bc3-9bda-5495f7099adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:01.845660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c62ce1-0a1b-4bc3-9bda-5495f7099adc admin admin] PATH_INFO: `/v3/projects/04a3d5a4c5b74e36bca78a1054121372` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:01.846825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c62ce1-0a1b-4bc3-9bda-5495f7099adc admin admin] RBAC: Authorizing `identity:get_project(project_id=04a3d5a4c5b74e36bca78a1054121372)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:01.848806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c62ce1-0a1b-4bc3-9bda-5495f7099adc admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:01.850412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 569/1143] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:27:01 2022] GET /identity/v3/projects/04a3d5a4c5b74e36bca78a1054121372 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:01.855684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5f29d-5e64-48c9-b6f8-233e72ce573b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:01.863978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5f29d-5e64-48c9-b6f8-233e72ce573b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:01.868393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400f581-30be-4dbf-ba33-bbef3d34fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:01.868988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400f581-30be-4dbf-ba33-bbef3d34fcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:01.869265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400f581-30be-4dbf-ba33-bbef3d34fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:01.869532 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400f581-30be-4dbf-ba33-bbef3d34fcf6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:01.870363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400f581-30be-4dbf-ba33-bbef3d34fcf6 admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=04a3d5a4c5b74e36bca78a1054121372, user.id=76cd9e2ab50c4409ace63b4ad17deb38) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:27:01.870666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400f581-30be-4dbf-ba33-bbef3d34fcf6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:01.872432 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400f581-30be-4dbf-ba33-bbef3d34fcf6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:01.877953 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 575/1144] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:27:01 2022] GET /identity/v3/role_assignments?user.id=76cd9e2ab50c4409ace63b4ad17deb38&scope.project.id=04a3d5a4c5b74e36bca78a1054121372&role.id=548abad662724741a3261205ee7cb828 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:04.116938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03eab1-b3dd-449c-9b04-6d09b4fb21fc None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:04.117413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03eab1-b3dd-449c-9b04-6d09b4fb21fc None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:04.117513 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03eab1-b3dd-449c-9b04-6d09b4fb21fc None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:04.119269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 570/1145] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:27:04.124658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723235a4-cb54-4d24-a268-6f2ae4f3ad68 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:04.125080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723235a4-cb54-4d24-a268-6f2ae4f3ad68 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:04.125211 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723235a4-cb54-4d24-a268-6f2ae4f3ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:04.143688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-723235a4-cb54-4d24-a268-6f2ae4f3ad68 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:27:04.144856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-723235a4-cb54-4d24-a268-6f2ae4f3ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:27:04.152928 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 576/1146] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:27:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:27:04.175737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03eab1-b3dd-449c-9b04-6d09b4fb21fc None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:04.187409 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03eab1-b3dd-449c-9b04-6d09b4fb21fc None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:04.191633 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81615b8-a708-4ce8-9a59-633bb3a7feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:04.192388 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81615b8-a708-4ce8-9a59-633bb3a7feb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:04.192669 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81615b8-a708-4ce8-9a59-633bb3a7feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:04.192942 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81615b8-a708-4ce8-9a59-633bb3a7feb7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:04.203219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81615b8-a708-4ce8-9a59-633bb3a7feb7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:27:04.209927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-f81615b8-a708-4ce8-9a59-633bb3a7feb7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:27:04.211069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 571/1147] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:27:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:27:04.217055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723235a4-cb54-4d24-a268-6f2ae4f3ad68 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:04.225581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723235a4-cb54-4d24-a268-6f2ae4f3ad68 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:04.229960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9a033-736a-4c69-823d-27e264233fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:04.230638 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9a033-736a-4c69-823d-27e264233fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:04.230920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9a033-736a-4c69-823d-27e264233fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:04.231191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9a033-736a-4c69-823d-27e264233fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:04.231923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9a033-736a-4c69-823d-27e264233fa9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:27:04.232232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9a033-736a-4c69-823d-27e264233fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:04.233805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9a033-736a-4c69-823d-27e264233fa9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:04.241704 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 577/1148] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:27:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:04.247108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81615b8-a708-4ce8-9a59-633bb3a7feb7 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:04.257034 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81615b8-a708-4ce8-9a59-633bb3a7feb7 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:04.261430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55ad1e-2331-4181-a89b-d95c0b79bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:04.262762 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ad1e-2331-4181-a89b-d95c0b79bbec admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:04.263043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ad1e-2331-4181-a89b-d95c0b79bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:04.263316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ad1e-2331-4181-a89b-d95c0b79bbec admin admin] PATH_INFO: `/v3/users/76cd9e2ab50c4409ace63b4ad17deb38` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:04.264513 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55ad1e-2331-4181-a89b-d95c0b79bbec admin admin] RBAC: Authorizing `identity:get_user(user_id=76cd9e2ab50c4409ace63b4ad17deb38)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:04.266635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55ad1e-2331-4181-a89b-d95c0b79bbec admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:04.268145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 572/1149] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:27:04 2022] GET /identity/v3/users/76cd9e2ab50c4409ace63b4ad17deb38 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:04.273090 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9a033-736a-4c69-823d-27e264233fa9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:04.282731 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9a033-736a-4c69-823d-27e264233fa9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:04.287064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88318594-6b9e-4e4a-804d-59d8f88844ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:04.287858 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88318594-6b9e-4e4a-804d-59d8f88844ca admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:04.288131 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88318594-6b9e-4e4a-804d-59d8f88844ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:04.288395 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88318594-6b9e-4e4a-804d-59d8f88844ca admin admin] PATH_INFO: `/v3/projects/04a3d5a4c5b74e36bca78a1054121372` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:04.289511 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88318594-6b9e-4e4a-804d-59d8f88844ca admin admin] RBAC: Authorizing `identity:get_project(project_id=04a3d5a4c5b74e36bca78a1054121372)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:04.291540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88318594-6b9e-4e4a-804d-59d8f88844ca admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:04.293113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 578/1150] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:27:04 2022] GET /identity/v3/projects/04a3d5a4c5b74e36bca78a1054121372 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:27:04.298112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55ad1e-2331-4181-a89b-d95c0b79bbec admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:04.307081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55ad1e-2331-4181-a89b-d95c0b79bbec admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:04.311545 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde7a88-e435-450d-a751-13ec1befbf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:04.312360 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde7a88-e435-450d-a751-13ec1befbf49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:04.312641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde7a88-e435-450d-a751-13ec1befbf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:04.312944 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde7a88-e435-450d-a751-13ec1befbf49 admin admin] PATH_INFO: `/v3/projects/04a3d5a4c5b74e36bca78a1054121372/users/76cd9e2ab50c4409ace63b4ad17deb38/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:04.314857 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde7a88-e435-450d-a751-13ec1befbf49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a3d5a4c5b74e36bca78a1054121372, user_id=76cd9e2ab50c4409ace63b4ad17deb38, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:04.317406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde7a88-e435-450d-a751-13ec1befbf49 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:04.330346 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 573/1151] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:27:04 2022] PUT /identity/v3/projects/04a3d5a4c5b74e36bca78a1054121372/users/76cd9e2ab50c4409ace63b4ad17deb38/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:27:06.552754 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34216f69-4b0a-4b5a-9534-42e07928a1c9 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:06.553273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34216f69-4b0a-4b5a-9534-42e07928a1c9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:06.553273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34216f69-4b0a-4b5a-9534-42e07928a1c9 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:06.555091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 579/1152] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:27:06.560708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93980929-8fe3-47a3-bdac-c2e9e9ba47f1 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:06.561137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93980929-8fe3-47a3-bdac-c2e9e9ba47f1 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:06.561258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93980929-8fe3-47a3-bdac-c2e9e9ba47f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:06.578433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-93980929-8fe3-47a3-bdac-c2e9e9ba47f1 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:27:06.579607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-93980929-8fe3-47a3-bdac-c2e9e9ba47f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:27:06.633821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 574/1153] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:27:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:27:06.657546 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34216f69-4b0a-4b5a-9534-42e07928a1c9 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:06.669887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34216f69-4b0a-4b5a-9534-42e07928a1c9 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:06.674106 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4074a6-91ba-4571-b7e9-48d769422c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:06.674889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4074a6-91ba-4571-b7e9-48d769422c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:06.675166 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4074a6-91ba-4571-b7e9-48d769422c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:06.675433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4074a6-91ba-4571-b7e9-48d769422c70 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:06.685011 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4074a6-91ba-4571-b7e9-48d769422c70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:27:06.691671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-aa4074a6-91ba-4571-b7e9-48d769422c70 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:27:06.692786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 580/1154] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:27:06.698498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93980929-8fe3-47a3-bdac-c2e9e9ba47f1 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:06.707058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93980929-8fe3-47a3-bdac-c2e9e9ba47f1 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:06.711467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203cf89-eb0d-4171-8ba3-380c4af26c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:06.712108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203cf89-eb0d-4171-8ba3-380c4af26c83 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:06.712388 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203cf89-eb0d-4171-8ba3-380c4af26c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:06.712660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203cf89-eb0d-4171-8ba3-380c4af26c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:06.713397 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203cf89-eb0d-4171-8ba3-380c4af26c83 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:27:06.713697 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203cf89-eb0d-4171-8ba3-380c4af26c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:06.715828 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203cf89-eb0d-4171-8ba3-380c4af26c83 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:06.723691 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 575/1155] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:27:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:06.728875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4074a6-91ba-4571-b7e9-48d769422c70 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:06.739315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4074a6-91ba-4571-b7e9-48d769422c70 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:06.743641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc4160-9e87-4442-b800-f9f53a6b62b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:06.744444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc4160-9e87-4442-b800-f9f53a6b62b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:06.744724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc4160-9e87-4442-b800-f9f53a6b62b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:06.744992 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc4160-9e87-4442-b800-f9f53a6b62b7 admin admin] PATH_INFO: `/v3/users/76cd9e2ab50c4409ace63b4ad17deb38` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:06.746685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc4160-9e87-4442-b800-f9f53a6b62b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=76cd9e2ab50c4409ace63b4ad17deb38)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:06.749569 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc4160-9e87-4442-b800-f9f53a6b62b7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:06.751170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 581/1156] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:27:06 2022] GET /identity/v3/users/76cd9e2ab50c4409ace63b4ad17deb38 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:06.756714 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203cf89-eb0d-4171-8ba3-380c4af26c83 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:06.766033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203cf89-eb0d-4171-8ba3-380c4af26c83 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:06.770399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd92b96-8ec5-4076-acf2-c4a8d2de9544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:06.771015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd92b96-8ec5-4076-acf2-c4a8d2de9544 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:06.771294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd92b96-8ec5-4076-acf2-c4a8d2de9544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:06.771565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd92b96-8ec5-4076-acf2-c4a8d2de9544 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:06.779440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd92b96-8ec5-4076-acf2-c4a8d2de9544 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:06.781149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd92b96-8ec5-4076-acf2-c4a8d2de9544 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:06.789528 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 576/1157] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:27:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:27:06.795595 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc4160-9e87-4442-b800-f9f53a6b62b7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:06.804808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc4160-9e87-4442-b800-f9f53a6b62b7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:06.809150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2527ef-1226-4077-b4f5-9c5070824b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:06.809949 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2527ef-1226-4077-b4f5-9c5070824b8a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:06.810251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2527ef-1226-4077-b4f5-9c5070824b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:06.810524 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2527ef-1226-4077-b4f5-9c5070824b8a admin admin] PATH_INFO: `/v3/projects/04a3d5a4c5b74e36bca78a1054121372` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:06.811654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2527ef-1226-4077-b4f5-9c5070824b8a admin admin] RBAC: Authorizing `identity:get_project(project_id=04a3d5a4c5b74e36bca78a1054121372)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:06.813742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2527ef-1226-4077-b4f5-9c5070824b8a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:06.815373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 582/1158] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:27:06 2022] GET /identity/v3/projects/04a3d5a4c5b74e36bca78a1054121372 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:06.820729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd92b96-8ec5-4076-acf2-c4a8d2de9544 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:06.829162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd92b96-8ec5-4076-acf2-c4a8d2de9544 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:06.833605 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16ecf2-989b-4d78-90e7-92ac2009f3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:06.834225 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16ecf2-989b-4d78-90e7-92ac2009f3df admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:06.834537 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16ecf2-989b-4d78-90e7-92ac2009f3df admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:06.834812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16ecf2-989b-4d78-90e7-92ac2009f3df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:06.835608 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16ecf2-989b-4d78-90e7-92ac2009f3df admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=04a3d5a4c5b74e36bca78a1054121372, user.id=76cd9e2ab50c4409ace63b4ad17deb38) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:27:06.835912 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16ecf2-989b-4d78-90e7-92ac2009f3df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:06.837684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16ecf2-989b-4d78-90e7-92ac2009f3df admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:06.843870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 577/1159] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:27:06 2022] GET /identity/v3/role_assignments?user.id=76cd9e2ab50c4409ace63b4ad17deb38&scope.project.id=04a3d5a4c5b74e36bca78a1054121372&role.id=548abad662724741a3261205ee7cb828 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:27:09.127655 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110388b-b02c-48a1-9fc9-9c244af5e429 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:09.128086 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110388b-b02c-48a1-9fc9-9c244af5e429 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:09.128205 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110388b-b02c-48a1-9fc9-9c244af5e429 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:09.129976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 583/1160] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:27:09.135274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bf6be-0c42-4694-a591-24ab35e2769d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:09.135642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bf6be-0c42-4694-a591-24ab35e2769d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:09.135830 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bf6be-0c42-4694-a591-24ab35e2769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:09.153559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-395bf6be-0c42-4694-a591-24ab35e2769d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:27:09.154836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-395bf6be-0c42-4694-a591-24ab35e2769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:27:09.162387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 578/1161] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:27:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:27:09.185348 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110388b-b02c-48a1-9fc9-9c244af5e429 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:09.197046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110388b-b02c-48a1-9fc9-9c244af5e429 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:09.201333 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4173ab1-26db-45b7-b35d-42b264779e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:09.201947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4173ab1-26db-45b7-b35d-42b264779e70 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:09.202256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4173ab1-26db-45b7-b35d-42b264779e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:09.202532 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4173ab1-26db-45b7-b35d-42b264779e70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:09.209929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4173ab1-26db-45b7-b35d-42b264779e70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:09.211681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4173ab1-26db-45b7-b35d-42b264779e70 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:09.220697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 584/1162] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:27:09 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:27:09.226102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bf6be-0c42-4694-a591-24ab35e2769d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:09.235355 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bf6be-0c42-4694-a591-24ab35e2769d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:09.239805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69973c-fedd-4ef7-af4c-7bbe2ceb829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:09.240586 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69973c-fedd-4ef7-af4c-7bbe2ceb829d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:09.240869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69973c-fedd-4ef7-af4c-7bbe2ceb829d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:09.241144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69973c-fedd-4ef7-af4c-7bbe2ceb829d admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:09.247806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69973c-fedd-4ef7-af4c-7bbe2ceb829d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:09.249862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69973c-fedd-4ef7-af4c-7bbe2ceb829d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:09.265390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-fb69973c-fedd-4ef7-af4c-7bbe2ceb829d admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 21 01:27:09.266533 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 579/1163] 10.222.0.79 () {56 vars in 1138 bytes} [Mon Feb 21 01:27:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:27:09.272046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4173ab1-26db-45b7-b35d-42b264779e70 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:09.281018 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4173ab1-26db-45b7-b35d-42b264779e70 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:09.285467 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003ae47-3451-4f54-af83-faa1c94c72a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:09.286093 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003ae47-3451-4f54-af83-faa1c94c72a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:09.286407 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003ae47-3451-4f54-af83-faa1c94c72a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:09.286680 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003ae47-3451-4f54-af83-faa1c94c72a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:09.287385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003ae47-3451-4f54-af83-faa1c94c72a6 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:27:09.287684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003ae47-3451-4f54-af83-faa1c94c72a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:09.289229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003ae47-3451-4f54-af83-faa1c94c72a6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:09.296229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 585/1164] 10.222.0.79 () {56 vars in 1136 bytes} [Mon Feb 21 01:27:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:11.584117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15e725-f188-43e8-8f60-40a71bc3b0b3 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:11.584641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15e725-f188-43e8-8f60-40a71bc3b0b3 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:11.584731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15e725-f188-43e8-8f60-40a71bc3b0b3 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:11.586464 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 580/1165] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:27:11.592164 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ddd94-2f59-4e49-8493-e1408bd305d7 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:11.592581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ddd94-2f59-4e49-8493-e1408bd305d7 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:11.592687 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ddd94-2f59-4e49-8493-e1408bd305d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:11.609717 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-6d7ddd94-2f59-4e49-8493-e1408bd305d7 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:27:11.610920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6d7ddd94-2f59-4e49-8493-e1408bd305d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:27:11.618318 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 586/1166] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:27:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:27:11.641748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15e725-f188-43e8-8f60-40a71bc3b0b3 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:11.654231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15e725-f188-43e8-8f60-40a71bc3b0b3 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:11.660055 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeda17c-c3ba-4e33-97e3-db3937fa1fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:11.660693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeda17c-c3ba-4e33-97e3-db3937fa1fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:11.660974 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeda17c-c3ba-4e33-97e3-db3937fa1fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:11.661247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeda17c-c3ba-4e33-97e3-db3937fa1fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:11.661995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeda17c-c3ba-4e33-97e3-db3937fa1fc4 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:11.663047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-8aeda17c-c3ba-4e33-97e3-db3937fa1fc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:27:11.663047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:27:11.663047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:27:11.663930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeda17c-c3ba-4e33-97e3-db3937fa1fc4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:11.678915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 581/1167] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Feb 21 01:27:11 2022] POST /identity/v3/domains => generated 267 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:27:13.990515 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4dae6-f9e3-4ed2-abd5-7daca2761b03 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:13.991067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4dae6-f9e3-4ed2-abd5-7daca2761b03 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:13.991067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4dae6-f9e3-4ed2-abd5-7daca2761b03 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:13.992815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 587/1168] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:27:13.998737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc277fd-ce8d-46e5-b988-b5551f54132d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:13.999413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc277fd-ce8d-46e5-b988-b5551f54132d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:13.999524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc277fd-ce8d-46e5-b988-b5551f54132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:14.016731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-9bc277fd-ce8d-46e5-b988-b5551f54132d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:27:14.017894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9bc277fd-ce8d-46e5-b988-b5551f54132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:27:14.073021 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 582/1169] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:27:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:27:14.096343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4dae6-f9e3-4ed2-abd5-7daca2761b03 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:14.108616 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4dae6-f9e3-4ed2-abd5-7daca2761b03 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:14.112845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23267639-4970-4e01-af38-9c1a9139ee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:14.113672 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23267639-4970-4e01-af38-9c1a9139ee33 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:14.113947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23267639-4970-4e01-af38-9c1a9139ee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:14.114234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23267639-4970-4e01-af38-9c1a9139ee33 admin admin] PATH_INFO: `/v3/domains/e9dae24ef3b94eb9b2ce61aa9d0cfd03` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:14.125268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23267639-4970-4e01-af38-9c1a9139ee33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=e9dae24ef3b94eb9b2ce61aa9d0cfd03)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:14.127227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23267639-4970-4e01-af38-9c1a9139ee33 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:14.128785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 588/1170] 10.222.0.79 () {56 vars in 1204 bytes} [Mon Feb 21 01:27:14 2022] GET /identity/v3/domains/e9dae24ef3b94eb9b2ce61aa9d0cfd03 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:14.134502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc277fd-ce8d-46e5-b988-b5551f54132d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:14.145854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc277fd-ce8d-46e5-b988-b5551f54132d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:14.150353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82301b7e-47fa-4a12-b50a-522c96473338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:14.151004 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301b7e-47fa-4a12-b50a-522c96473338 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:14.151283 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301b7e-47fa-4a12-b50a-522c96473338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:14.151586 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301b7e-47fa-4a12-b50a-522c96473338 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:14.152806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82301b7e-47fa-4a12-b50a-522c96473338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:14.154790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82301b7e-47fa-4a12-b50a-522c96473338 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:14.179442 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 583/1171] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:27:14 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:27:16.469510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16b2c-eb1c-4890-adb3-003c5e9ab536 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:16.470021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16b2c-eb1c-4890-adb3-003c5e9ab536 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:16.470107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16b2c-eb1c-4890-adb3-003c5e9ab536 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:16.471844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 589/1172] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:27:16.477226 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace47f85-0eb6-498b-b7e7-76e4acdda763 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:16.477618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace47f85-0eb6-498b-b7e7-76e4acdda763 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:16.477778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace47f85-0eb6-498b-b7e7-76e4acdda763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:16.494875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-ace47f85-0eb6-498b-b7e7-76e4acdda763 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:27:16.496532 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ace47f85-0eb6-498b-b7e7-76e4acdda763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:27:16.550335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 584/1173] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:27:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:27:16.576356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16b2c-eb1c-4890-adb3-003c5e9ab536 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:16.588187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16b2c-eb1c-4890-adb3-003c5e9ab536 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:16.592539 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e9dac-6cdf-468f-ab95-18da3b523af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:16.593364 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e9dac-6cdf-468f-ab95-18da3b523af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:16.593647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e9dac-6cdf-468f-ab95-18da3b523af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:16.593919 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e9dac-6cdf-468f-ab95-18da3b523af5 admin admin] PATH_INFO: `/v3/domains/e9dae24ef3b94eb9b2ce61aa9d0cfd03` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:16.595116 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e9dac-6cdf-468f-ab95-18da3b523af5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=e9dae24ef3b94eb9b2ce61aa9d0cfd03)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:16.597043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e9dac-6cdf-468f-ab95-18da3b523af5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:16.598635 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 590/1174] 10.222.0.79 () {56 vars in 1204 bytes} [Mon Feb 21 01:27:16 2022] GET /identity/v3/domains/e9dae24ef3b94eb9b2ce61aa9d0cfd03 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:16.603827 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace47f85-0eb6-498b-b7e7-76e4acdda763 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:16.612348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace47f85-0eb6-498b-b7e7-76e4acdda763 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:16.616712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d7de8-c15b-4dfe-855d-865550f3f287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:16.617354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d7de8-c15b-4dfe-855d-865550f3f287 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:16.617637 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d7de8-c15b-4dfe-855d-865550f3f287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:16.617910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d7de8-c15b-4dfe-855d-865550f3f287 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:16.618645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d7de8-c15b-4dfe-855d-865550f3f287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:16.621072 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d7de8-c15b-4dfe-855d-865550f3f287 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:16.640562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 585/1175] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:27:16 2022] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:27:18.951704 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ed893-87a2-4b16-ae8f-3cbef6bb1301 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:18.952267 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ed893-87a2-4b16-ae8f-3cbef6bb1301 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:18.952267 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ed893-87a2-4b16-ae8f-3cbef6bb1301 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:18.953981 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 591/1176] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:27:18.959176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c061de-0fbb-42a2-92e8-1e71d264fd54 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:18.959586 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c061de-0fbb-42a2-92e8-1e71d264fd54 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:18.959726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c061de-0fbb-42a2-92e8-1e71d264fd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:18.976758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-84c061de-0fbb-42a2-92e8-1e71d264fd54 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:27:18.977922 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-84c061de-0fbb-42a2-92e8-1e71d264fd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:27:18.985883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 586/1177] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:27:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:27:19.009506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ed893-87a2-4b16-ae8f-3cbef6bb1301 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:19.021159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ed893-87a2-4b16-ae8f-3cbef6bb1301 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:19.025380 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff74231-6123-4b5f-aff1-74da1744b4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:19.026121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff74231-6123-4b5f-aff1-74da1744b4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:19.026424 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff74231-6123-4b5f-aff1-74da1744b4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:19.026691 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff74231-6123-4b5f-aff1-74da1744b4b6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:19.036708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff74231-6123-4b5f-aff1-74da1744b4b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:27:19.043917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-fff74231-6123-4b5f-aff1-74da1744b4b6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:27:19.045027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 592/1178] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:27:19.050632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c061de-0fbb-42a2-92e8-1e71d264fd54 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:19.059842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c061de-0fbb-42a2-92e8-1e71d264fd54 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:19.064223 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83ca80-1679-4d70-80ad-70abfaf776a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:19.064866 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ca80-1679-4d70-80ad-70abfaf776a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:19.065147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ca80-1679-4d70-80ad-70abfaf776a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:19.065420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ca80-1679-4d70-80ad-70abfaf776a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:19.066158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83ca80-1679-4d70-80ad-70abfaf776a9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:27:19.066497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83ca80-1679-4d70-80ad-70abfaf776a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:19.068080 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83ca80-1679-4d70-80ad-70abfaf776a9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:19.075998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 587/1179] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:27:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:19.081212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff74231-6123-4b5f-aff1-74da1744b4b6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:19.090496 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff74231-6123-4b5f-aff1-74da1744b4b6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:19.095184 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f56fe-4244-4bd6-9754-5a3c8eb48fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:19.096022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f56fe-4244-4bd6-9754-5a3c8eb48fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:19.096303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f56fe-4244-4bd6-9754-5a3c8eb48fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:19.096577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f56fe-4244-4bd6-9754-5a3c8eb48fc5 admin admin] PATH_INFO: `/v3/users/c1b70d14d0ed420fb015d7922b9ccbd7` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:19.110246 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f56fe-4244-4bd6-9754-5a3c8eb48fc5 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1b70d14d0ed420fb015d7922b9ccbd7)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:19.112380 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f56fe-4244-4bd6-9754-5a3c8eb48fc5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:19.113977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 593/1180] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:27:19 2022] GET /identity/v3/users/c1b70d14d0ed420fb015d7922b9ccbd7 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:19.119600 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83ca80-1679-4d70-80ad-70abfaf776a9 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:19.129783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83ca80-1679-4d70-80ad-70abfaf776a9 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:19.134194 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5e467-830c-4eff-8fc9-766762be72fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:19.134847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5e467-830c-4eff-8fc9-766762be72fd admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:19.135129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5e467-830c-4eff-8fc9-766762be72fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:19.135403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5e467-830c-4eff-8fc9-766762be72fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:19.142880 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5e467-830c-4eff-8fc9-766762be72fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:19.144598 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5e467-830c-4eff-8fc9-766762be72fd admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:19.153065 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 588/1181] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:27:19 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:27:19.158227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f56fe-4244-4bd6-9754-5a3c8eb48fc5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:19.167818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f56fe-4244-4bd6-9754-5a3c8eb48fc5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:19.172228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf1c50-1611-4678-b852-6ac9b4290a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:19.173031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf1c50-1611-4678-b852-6ac9b4290a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:19.173311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf1c50-1611-4678-b852-6ac9b4290a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:19.173584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf1c50-1611-4678-b852-6ac9b4290a23 admin admin] PATH_INFO: `/v3/projects/379779d8d4ab4b2ea1df10c87796b4e4` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:19.174744 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf1c50-1611-4678-b852-6ac9b4290a23 admin admin] RBAC: Authorizing `identity:get_project(project_id=379779d8d4ab4b2ea1df10c87796b4e4)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:19.176731 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf1c50-1611-4678-b852-6ac9b4290a23 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:19.178344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 594/1182] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:27:19 2022] GET /identity/v3/projects/379779d8d4ab4b2ea1df10c87796b4e4 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:19.184495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5e467-830c-4eff-8fc9-766762be72fd admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:19.192812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5e467-830c-4eff-8fc9-766762be72fd admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:19.197213 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5fbff-0fac-4e08-b2dd-65ee75c48dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:19.197808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5fbff-0fac-4e08-b2dd-65ee75c48dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:19.198089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5fbff-0fac-4e08-b2dd-65ee75c48dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:19.198401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5fbff-0fac-4e08-b2dd-65ee75c48dd1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:19.199197 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5fbff-0fac-4e08-b2dd-65ee75c48dd1 admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=379779d8d4ab4b2ea1df10c87796b4e4, user.id=c1b70d14d0ed420fb015d7922b9ccbd7) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:27:19.199502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5fbff-0fac-4e08-b2dd-65ee75c48dd1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:19.201268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5fbff-0fac-4e08-b2dd-65ee75c48dd1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:19.206419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 589/1183] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:27:19 2022] GET /identity/v3/role_assignments?user.id=c1b70d14d0ed420fb015d7922b9ccbd7&scope.project.id=379779d8d4ab4b2ea1df10c87796b4e4&role.id=548abad662724741a3261205ee7cb828 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:21.442707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d49b0-1792-4972-9604-6b99b2b626c3 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:21.443244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d49b0-1792-4972-9604-6b99b2b626c3 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:21.443244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d49b0-1792-4972-9604-6b99b2b626c3 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:21.445009 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 595/1184] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:27:21.450736 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7422957-ff59-4269-bc46-6606a0a7de18 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:21.451105 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7422957-ff59-4269-bc46-6606a0a7de18 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:21.451289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7422957-ff59-4269-bc46-6606a0a7de18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:21.468808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-c7422957-ff59-4269-bc46-6606a0a7de18 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:27:21.469963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c7422957-ff59-4269-bc46-6606a0a7de18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:27:21.477416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 590/1185] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:27:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:27:21.499881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d49b0-1792-4972-9604-6b99b2b626c3 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:21.512140 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d49b0-1792-4972-9604-6b99b2b626c3 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:21.516510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95210706-54a6-422d-be8c-bf3dd3b9cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:21.517263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95210706-54a6-422d-be8c-bf3dd3b9cb32 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:21.517535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95210706-54a6-422d-be8c-bf3dd3b9cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:21.517799 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95210706-54a6-422d-be8c-bf3dd3b9cb32 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:21.527974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95210706-54a6-422d-be8c-bf3dd3b9cb32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:27:21.534783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-95210706-54a6-422d-be8c-bf3dd3b9cb32 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:27:21.535901 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 596/1186] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:27:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:27:21.541500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7422957-ff59-4269-bc46-6606a0a7de18 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:21.554350 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7422957-ff59-4269-bc46-6606a0a7de18 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:21.559646 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6708b1f-7a88-41c7-a0d1-03e7c1974da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:21.560292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6708b1f-7a88-41c7-a0d1-03e7c1974da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:21.560571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6708b1f-7a88-41c7-a0d1-03e7c1974da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:21.560842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6708b1f-7a88-41c7-a0d1-03e7c1974da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:21.561581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6708b1f-7a88-41c7-a0d1-03e7c1974da4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:27:21.561881 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6708b1f-7a88-41c7-a0d1-03e7c1974da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:21.563499 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6708b1f-7a88-41c7-a0d1-03e7c1974da4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:21.571628 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 591/1187] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:27:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:21.577828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95210706-54a6-422d-be8c-bf3dd3b9cb32 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:21.587617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95210706-54a6-422d-be8c-bf3dd3b9cb32 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:21.592006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c7476-5d21-4fb4-adf2-0ff1f3366812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:21.592825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c7476-5d21-4fb4-adf2-0ff1f3366812 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:21.593097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c7476-5d21-4fb4-adf2-0ff1f3366812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:21.593363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c7476-5d21-4fb4-adf2-0ff1f3366812 admin admin] PATH_INFO: `/v3/users/c1b70d14d0ed420fb015d7922b9ccbd7` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:21.594544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c7476-5d21-4fb4-adf2-0ff1f3366812 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1b70d14d0ed420fb015d7922b9ccbd7)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:21.596624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c7476-5d21-4fb4-adf2-0ff1f3366812 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:21.598157 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 597/1188] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:27:21 2022] GET /identity/v3/users/c1b70d14d0ed420fb015d7922b9ccbd7 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:21.603293 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6708b1f-7a88-41c7-a0d1-03e7c1974da4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:21.612831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6708b1f-7a88-41c7-a0d1-03e7c1974da4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:21.617212 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc176-2b0b-4d26-b945-cf24141ddb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:21.618024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc176-2b0b-4d26-b945-cf24141ddb06 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:21.618362 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc176-2b0b-4d26-b945-cf24141ddb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:21.618634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc176-2b0b-4d26-b945-cf24141ddb06 admin admin] PATH_INFO: `/v3/projects/379779d8d4ab4b2ea1df10c87796b4e4` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:21.619770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc176-2b0b-4d26-b945-cf24141ddb06 admin admin] RBAC: Authorizing `identity:get_project(project_id=379779d8d4ab4b2ea1df10c87796b4e4)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:21.622408 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc176-2b0b-4d26-b945-cf24141ddb06 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:21.624236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 592/1189] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:27:21 2022] GET /identity/v3/projects/379779d8d4ab4b2ea1df10c87796b4e4 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:21.629374 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c7476-5d21-4fb4-adf2-0ff1f3366812 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:21.638516 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c7476-5d21-4fb4-adf2-0ff1f3366812 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:21.642848 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf6995-1bc3-47d6-8a20-1b29578b8713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:21.643664 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6995-1bc3-47d6-8a20-1b29578b8713 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:21.643946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6995-1bc3-47d6-8a20-1b29578b8713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:21.644216 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6995-1bc3-47d6-8a20-1b29578b8713 admin admin] PATH_INFO: `/v3/projects/379779d8d4ab4b2ea1df10c87796b4e4/users/c1b70d14d0ed420fb015d7922b9ccbd7/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:21.646097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf6995-1bc3-47d6-8a20-1b29578b8713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=379779d8d4ab4b2ea1df10c87796b4e4, user_id=c1b70d14d0ed420fb015d7922b9ccbd7, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:21.648664 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf6995-1bc3-47d6-8a20-1b29578b8713 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:21.661286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 598/1190] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:27:21 2022] PUT /identity/v3/projects/379779d8d4ab4b2ea1df10c87796b4e4/users/c1b70d14d0ed420fb015d7922b9ccbd7/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:27:23.913309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bb3d-c3f9-4e27-9bd8-537e85ee76a3 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:23.913835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bb3d-c3f9-4e27-9bd8-537e85ee76a3 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:23.913835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bb3d-c3f9-4e27-9bd8-537e85ee76a3 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:23.915627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 593/1191] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:27:23.921345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791842ba-89b8-4cc1-98af-1bceffd7bdd2 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:23.921762 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791842ba-89b8-4cc1-98af-1bceffd7bdd2 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:23.921902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791842ba-89b8-4cc1-98af-1bceffd7bdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:23.939175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-791842ba-89b8-4cc1-98af-1bceffd7bdd2 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:27:23.940345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-791842ba-89b8-4cc1-98af-1bceffd7bdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:27:23.994845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 599/1192] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:27:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:27:24.019422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bb3d-c3f9-4e27-9bd8-537e85ee76a3 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:24.031776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bb3d-c3f9-4e27-9bd8-537e85ee76a3 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:24.035996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7b66f-84e6-4c6b-8e89-f2c3f4cd0ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:24.036756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7b66f-84e6-4c6b-8e89-f2c3f4cd0ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:24.037036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7b66f-84e6-4c6b-8e89-f2c3f4cd0ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:24.037308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7b66f-84e6-4c6b-8e89-f2c3f4cd0ce1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:24.047911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7b66f-84e6-4c6b-8e89-f2c3f4cd0ce1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:27:24.054588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-72c7b66f-84e6-4c6b-8e89-f2c3f4cd0ce1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:27:24.055696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 594/1193] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:27:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:27:24.062043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791842ba-89b8-4cc1-98af-1bceffd7bdd2 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:24.070661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791842ba-89b8-4cc1-98af-1bceffd7bdd2 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:24.075657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c53256-6027-4f2e-8397-684a5934a883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:24.076294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53256-6027-4f2e-8397-684a5934a883 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:24.076572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53256-6027-4f2e-8397-684a5934a883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:24.076868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53256-6027-4f2e-8397-684a5934a883 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:24.077608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c53256-6027-4f2e-8397-684a5934a883 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:27:24.077916 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c53256-6027-4f2e-8397-684a5934a883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:24.079531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c53256-6027-4f2e-8397-684a5934a883 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:24.087486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 600/1194] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:27:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:24.093132 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7b66f-84e6-4c6b-8e89-f2c3f4cd0ce1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:24.103195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7b66f-84e6-4c6b-8e89-f2c3f4cd0ce1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:24.107709 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72ad43-0b78-4fea-815a-b1c2686f7f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:24.108541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72ad43-0b78-4fea-815a-b1c2686f7f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:24.108823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72ad43-0b78-4fea-815a-b1c2686f7f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:24.109100 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72ad43-0b78-4fea-815a-b1c2686f7f31 admin admin] PATH_INFO: `/v3/users/c1b70d14d0ed420fb015d7922b9ccbd7` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:24.110291 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72ad43-0b78-4fea-815a-b1c2686f7f31 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1b70d14d0ed420fb015d7922b9ccbd7)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:24.112399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72ad43-0b78-4fea-815a-b1c2686f7f31 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:24.113946 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 595/1195] 10.222.0.79 () {56 vars in 1198 bytes} [Mon Feb 21 01:27:24 2022] GET /identity/v3/users/c1b70d14d0ed420fb015d7922b9ccbd7 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:27:24.119324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c53256-6027-4f2e-8397-684a5934a883 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:24.129478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c53256-6027-4f2e-8397-684a5934a883 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:24.133926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170d209-074b-4ef6-b571-076f19072848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:24.134586 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170d209-074b-4ef6-b571-076f19072848 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:24.134871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170d209-074b-4ef6-b571-076f19072848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:24.135152 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170d209-074b-4ef6-b571-076f19072848 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:24.143360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170d209-074b-4ef6-b571-076f19072848 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:24.145108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170d209-074b-4ef6-b571-076f19072848 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:24.153700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 601/1196] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:27:24 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:27:24.158923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72ad43-0b78-4fea-815a-b1c2686f7f31 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:24.168129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72ad43-0b78-4fea-815a-b1c2686f7f31 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:24.172469 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22c3f0-509c-456a-bec7-ebf7bb1eb610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:24.173261 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22c3f0-509c-456a-bec7-ebf7bb1eb610 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:24.173535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22c3f0-509c-456a-bec7-ebf7bb1eb610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:24.173801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22c3f0-509c-456a-bec7-ebf7bb1eb610 admin admin] PATH_INFO: `/v3/projects/379779d8d4ab4b2ea1df10c87796b4e4` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:24.174964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22c3f0-509c-456a-bec7-ebf7bb1eb610 admin admin] RBAC: Authorizing `identity:get_project(project_id=379779d8d4ab4b2ea1df10c87796b4e4)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:24.176926 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22c3f0-509c-456a-bec7-ebf7bb1eb610 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:24.178571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 596/1197] 10.222.0.79 () {56 vars in 1207 bytes} [Mon Feb 21 01:27:24 2022] GET /identity/v3/projects/379779d8d4ab4b2ea1df10c87796b4e4 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:27:24.184698 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170d209-074b-4ef6-b571-076f19072848 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:24.193126 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170d209-074b-4ef6-b571-076f19072848 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:24.197629 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40742f-b73a-40ac-8503-c773d532a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:24.198811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40742f-b73a-40ac-8503-c773d532a94f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:24.199092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40742f-b73a-40ac-8503-c773d532a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:24.199364 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40742f-b73a-40ac-8503-c773d532a94f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:24.200169 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40742f-b73a-40ac-8503-c773d532a94f admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=379779d8d4ab4b2ea1df10c87796b4e4, user.id=c1b70d14d0ed420fb015d7922b9ccbd7) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:27:24.200473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40742f-b73a-40ac-8503-c773d532a94f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:24.202279 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40742f-b73a-40ac-8503-c773d532a94f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:24.207934 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 602/1198] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:27:24 2022] GET /identity/v3/role_assignments?user.id=c1b70d14d0ed420fb015d7922b9ccbd7&scope.project.id=379779d8d4ab4b2ea1df10c87796b4e4&role.id=548abad662724741a3261205ee7cb828 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:25.812729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9fde-77d9-42f0-9aee-302f3f4b6941 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:25.813312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9fde-77d9-42f0-9aee-302f3f4b6941 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:25.813312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9fde-77d9-42f0-9aee-302f3f4b6941 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:25.815068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 597/1199] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:28:25.825147 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58113a-db05-433a-8a87-e1516db5b668 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:25.825654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58113a-db05-433a-8a87-e1516db5b668 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:25.825743 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58113a-db05-433a-8a87-e1516db5b668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:25.844110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-8e58113a-db05-433a-8a87-e1516db5b668 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:25.845320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8e58113a-db05-433a-8a87-e1516db5b668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:25.854644 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 603/1200] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:28:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:28:25.882395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9fde-77d9-42f0-9aee-302f3f4b6941 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:25.898970 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9fde-77d9-42f0-9aee-302f3f4b6941 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:25.907003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c3d80-89aa-4648-9a7a-2936d91a17ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:25.907804 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c3d80-89aa-4648-9a7a-2936d91a17ff admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:25.908151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c3d80-89aa-4648-9a7a-2936d91a17ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:25.908408 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c3d80-89aa-4648-9a7a-2936d91a17ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:25.921097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c3d80-89aa-4648-9a7a-2936d91a17ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:25.923131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c3d80-89aa-4648-9a7a-2936d91a17ff admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:25.942983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-c52c3d80-89aa-4648-9a7a-2936d91a17ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:25.944237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 598/1201] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:25.950549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58113a-db05-433a-8a87-e1516db5b668 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:25.959914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58113a-db05-433a-8a87-e1516db5b668 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:25.965684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269d0e8-1edd-43b2-a701-54dff08d6c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:25.966403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269d0e8-1edd-43b2-a701-54dff08d6c93 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:25.966664 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269d0e8-1edd-43b2-a701-54dff08d6c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:25.967038 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269d0e8-1edd-43b2-a701-54dff08d6c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:25.967675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269d0e8-1edd-43b2-a701-54dff08d6c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:25.967968 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269d0e8-1edd-43b2-a701-54dff08d6c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:25.969637 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269d0e8-1edd-43b2-a701-54dff08d6c93 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:25.989514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 604/1202] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:25.990492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c3d80-89aa-4648-9a7a-2936d91a17ff admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:26.001844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c3d80-89aa-4648-9a7a-2936d91a17ff admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:26.009463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3d4dc-7e6d-42ce-9353-032837547a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:26.010264 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3d4dc-7e6d-42ce-9353-032837547a39 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:26.010527 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3d4dc-7e6d-42ce-9353-032837547a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:26.010847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3d4dc-7e6d-42ce-9353-032837547a39 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:26.011632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3d4dc-7e6d-42ce-9353-032837547a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:26.013617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3d4dc-7e6d-42ce-9353-032837547a39 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:26.034912 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 599/1203] 10.222.0.79 () {60 vars in 1153 bytes} [Mon Feb 21 01:28:25 2022] POST /identity/v3/users => generated 251 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:28:28.708232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ea6fd-9eb8-4540-83e9-ec0798f9fe7a None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:28.708884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ea6fd-9eb8-4540-83e9-ec0798f9fe7a None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:28.708884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ea6fd-9eb8-4540-83e9-ec0798f9fe7a None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:28.711406 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 605/1204] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:28:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:28:28.717697 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f8630-12e3-44f7-b147-0180f44e846d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:28.718183 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f8630-12e3-44f7-b147-0180f44e846d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:28.718386 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f8630-12e3-44f7-b147-0180f44e846d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:28.743532 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-9c9f8630-12e3-44f7-b147-0180f44e846d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:28.744876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9c9f8630-12e3-44f7-b147-0180f44e846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:28.754314 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 600/1205] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:28:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:28:28.780701 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ea6fd-9eb8-4540-83e9-ec0798f9fe7a None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:28.795262 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ea6fd-9eb8-4540-83e9-ec0798f9fe7a None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:28.800711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1d7a-08ec-420b-9a4b-96d532b8c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:28.801769 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1d7a-08ec-420b-9a4b-96d532b8c4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:28.802051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1d7a-08ec-420b-9a4b-96d532b8c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:28.802564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1d7a-08ec-420b-9a4b-96d532b8c4a5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:28.816581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1d7a-08ec-420b-9a4b-96d532b8c4a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:28:28.828147 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-06cc1d7a-08ec-420b-9a4b-96d532b8c4a5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:28:28.829727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 606/1206] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:28:28.836660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f8630-12e3-44f7-b147-0180f44e846d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:28.846309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f8630-12e3-44f7-b147-0180f44e846d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:28.851565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ca376-deff-4f23-894e-22f9b15174e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:28.852390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca376-deff-4f23-894e-22f9b15174e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:28.852693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca376-deff-4f23-894e-22f9b15174e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:28.852937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca376-deff-4f23-894e-22f9b15174e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:28.853819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ca376-deff-4f23-894e-22f9b15174e1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:28.854043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ca376-deff-4f23-894e-22f9b15174e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:28.855979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ca376-deff-4f23-894e-22f9b15174e1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:28.867842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 601/1207] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:28.874326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1d7a-08ec-420b-9a4b-96d532b8c4a5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:28.885834 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1d7a-08ec-420b-9a4b-96d532b8c4a5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:28.896083 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f5bd4-fbb0-44f0-986b-59b5e94e71ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:28.896878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f5bd4-fbb0-44f0-986b-59b5e94e71ab admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:28.897153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f5bd4-fbb0-44f0-986b-59b5e94e71ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:28.897424 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f5bd4-fbb0-44f0-986b-59b5e94e71ab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:28.909421 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f5bd4-fbb0-44f0-986b-59b5e94e71ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:28.911472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f5bd4-fbb0-44f0-986b-59b5e94e71ab admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:28.931872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-867f5bd4-fbb0-44f0-986b-59b5e94e71ab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:28.933431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 607/1208] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:28.947649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ca376-deff-4f23-894e-22f9b15174e1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:28.963738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ca376-deff-4f23-894e-22f9b15174e1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:28.974460 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d8603-f3f4-4cc9-bb81-6143468600b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:28.975215 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d8603-f3f4-4cc9-bb81-6143468600b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:28.975495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d8603-f3f4-4cc9-bb81-6143468600b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:28.975770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d8603-f3f4-4cc9-bb81-6143468600b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:28.976574 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d8603-f3f4-4cc9-bb81-6143468600b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:28.976886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d8603-f3f4-4cc9-bb81-6143468600b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:28.978598 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d8603-f3f4-4cc9-bb81-6143468600b8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:28.998563 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 602/1209] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:29.005133 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f5bd4-fbb0-44f0-986b-59b5e94e71ab admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:29.027535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f5bd4-fbb0-44f0-986b-59b5e94e71ab admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:29.032628 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150e4c6-2e82-421b-b5e0-155a414098fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:29.036640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150e4c6-2e82-421b-b5e0-155a414098fa admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:29.036640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150e4c6-2e82-421b-b5e0-155a414098fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:29.036640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150e4c6-2e82-421b-b5e0-155a414098fa admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:29.042907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150e4c6-2e82-421b-b5e0-155a414098fa admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:29.045170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150e4c6-2e82-421b-b5e0-155a414098fa admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:29.060663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-9150e4c6-2e82-421b-b5e0-155a414098fa admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 01:28:29.066251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 608/1210] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:29.067968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d8603-f3f4-4cc9-bb81-6143468600b8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:29.081039 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d8603-f3f4-4cc9-bb81-6143468600b8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:29.087854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc29d-9ad5-4422-877d-c168b07ad08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:29.088864 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc29d-9ad5-4422-877d-c168b07ad08c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:29.089152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc29d-9ad5-4422-877d-c168b07ad08c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:29.089469 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc29d-9ad5-4422-877d-c168b07ad08c admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:29.090383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dc29d-9ad5-4422-877d-c168b07ad08c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:29.090739 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dc29d-9ad5-4422-877d-c168b07ad08c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:29.092713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dc29d-9ad5-4422-877d-c168b07ad08c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:29.119920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 603/1211] 10.222.0.79 () {56 vars in 1164 bytes} [Mon Feb 21 01:28:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:29.128092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150e4c6-2e82-421b-b5e0-155a414098fa admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:29.142647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150e4c6-2e82-421b-b5e0-155a414098fa admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:29.147924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ace95-6ddd-430a-b72e-89ec8d55a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:29.148869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ace95-6ddd-430a-b72e-89ec8d55a4cb admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:29.148975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ace95-6ddd-430a-b72e-89ec8d55a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:29.149217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ace95-6ddd-430a-b72e-89ec8d55a4cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:29.159227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ace95-6ddd-430a-b72e-89ec8d55a4cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:29.161173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ace95-6ddd-430a-b72e-89ec8d55a4cb admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:29.174722 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 609/1212] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:28:29 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:28:29.183459 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc29d-9ad5-4422-877d-c168b07ad08c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:29.196386 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc29d-9ad5-4422-877d-c168b07ad08c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:29.202294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd979918-6d34-4d5a-9ddf-c946ebf537ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:29.203626 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd979918-6d34-4d5a-9ddf-c946ebf537ef admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:29.204247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd979918-6d34-4d5a-9ddf-c946ebf537ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:29.204828 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd979918-6d34-4d5a-9ddf-c946ebf537ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:29.217642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd979918-6d34-4d5a-9ddf-c946ebf537ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:29.220088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd979918-6d34-4d5a-9ddf-c946ebf537ef admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:29.241647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-bd979918-6d34-4d5a-9ddf-c946ebf537ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:29.248661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 604/1213] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:29.254236 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ace95-6ddd-430a-b72e-89ec8d55a4cb admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:29.263045 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ace95-6ddd-430a-b72e-89ec8d55a4cb admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:29.268526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2b897-e2c0-4086-9bbc-249ede691d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:29.269447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2b897-e2c0-4086-9bbc-249ede691d74 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:29.269941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2b897-e2c0-4086-9bbc-249ede691d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:29.271228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2b897-e2c0-4086-9bbc-249ede691d74 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:29.272173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2b897-e2c0-4086-9bbc-249ede691d74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:29.272683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2b897-e2c0-4086-9bbc-249ede691d74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:29.274723 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2b897-e2c0-4086-9bbc-249ede691d74 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:29.295316 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 610/1214] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:29.301818 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd979918-6d34-4d5a-9ddf-c946ebf537ef admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:29.313421 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd979918-6d34-4d5a-9ddf-c946ebf537ef admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:29.321823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592af26-6776-4f51-90f6-e702373bb12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:29.322665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592af26-6776-4f51-90f6-e702373bb12a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:29.323169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592af26-6776-4f51-90f6-e702373bb12a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:29.323531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592af26-6776-4f51-90f6-e702373bb12a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:29.331684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592af26-6776-4f51-90f6-e702373bb12a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:29.333656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592af26-6776-4f51-90f6-e702373bb12a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:29.347805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-6592af26-6776-4f51-90f6-e702373bb12a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:28:29.349199 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 605/1215] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:28:29.356121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2b897-e2c0-4086-9bbc-249ede691d74 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:29.372411 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2b897-e2c0-4086-9bbc-249ede691d74 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:29.378852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94f1c0-08ee-4bdf-a9eb-5561f829acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:29.379762 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94f1c0-08ee-4bdf-a9eb-5561f829acba admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:29.380177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94f1c0-08ee-4bdf-a9eb-5561f829acba admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:29.380727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94f1c0-08ee-4bdf-a9eb-5561f829acba admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:29.381593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94f1c0-08ee-4bdf-a9eb-5561f829acba admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:29.381938 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94f1c0-08ee-4bdf-a9eb-5561f829acba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:29.384639 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94f1c0-08ee-4bdf-a9eb-5561f829acba admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:29.407044 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 611/1216] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:29.408698 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592af26-6776-4f51-90f6-e702373bb12a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:29.420265 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592af26-6776-4f51-90f6-e702373bb12a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:29.425550 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03afc9-4c4c-4c5e-9271-1e4e52f65bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:29.426305 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03afc9-4c4c-4c5e-9271-1e4e52f65bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:29.426664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03afc9-4c4c-4c5e-9271-1e4e52f65bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:29.427015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03afc9-4c4c-4c5e-9271-1e4e52f65bf7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:29.427917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03afc9-4c4c-4c5e-9271-1e4e52f65bf7 admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=02e7385005924d4f8c220c986b9866de) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:29.428234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03afc9-4c4c-4c5e-9271-1e4e52f65bf7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:29.431170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03afc9-4c4c-4c5e-9271-1e4e52f65bf7 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:29.437753 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 606/1217] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:28:29 2022] GET /identity/v3/role_assignments?user.id=02e7385005924d4f8c220c986b9866de&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:28:32.022978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98be18-3e1d-4e26-9f2b-6b9bbe9c1afb None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.024184 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98be18-3e1d-4e26-9f2b-6b9bbe9c1afb None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.024184 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98be18-3e1d-4e26-9f2b-6b9bbe9c1afb None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.026869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 612/1218] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:28:32.033187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331fadd-fa7e-41f6-85eb-8e8f43d7f487 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.033659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331fadd-fa7e-41f6-85eb-8e8f43d7f487 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.033763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331fadd-fa7e-41f6-85eb-8e8f43d7f487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.052216 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-a331fadd-fa7e-41f6-85eb-8e8f43d7f487 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:32.053399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a331fadd-fa7e-41f6-85eb-8e8f43d7f487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:32.062412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 607/1219] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:28:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:28:32.092468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98be18-3e1d-4e26-9f2b-6b9bbe9c1afb None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:32.105409 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98be18-3e1d-4e26-9f2b-6b9bbe9c1afb None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:32.110958 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f63880-0044-4193-8aaa-1da7114c481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:32.111832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63880-0044-4193-8aaa-1da7114c481c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.112214 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63880-0044-4193-8aaa-1da7114c481c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.112491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63880-0044-4193-8aaa-1da7114c481c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.126107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f63880-0044-4193-8aaa-1da7114c481c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:28:32.135198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-78f63880-0044-4193-8aaa-1da7114c481c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:28:32.141915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 613/1220] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:28:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:32.143731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331fadd-fa7e-41f6-85eb-8e8f43d7f487 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:32.154860 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331fadd-fa7e-41f6-85eb-8e8f43d7f487 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:32.160161 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d1622-45e6-4b9b-bb19-d9d486ab8093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:32.160829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d1622-45e6-4b9b-bb19-d9d486ab8093 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.161108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d1622-45e6-4b9b-bb19-d9d486ab8093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.161378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d1622-45e6-4b9b-bb19-d9d486ab8093 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.162121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d1622-45e6-4b9b-bb19-d9d486ab8093 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:32.162470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d1622-45e6-4b9b-bb19-d9d486ab8093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:32.164088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d1622-45e6-4b9b-bb19-d9d486ab8093 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:32.173130 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 608/1221] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:28:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:28:32.179389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f63880-0044-4193-8aaa-1da7114c481c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:32.189361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f63880-0044-4193-8aaa-1da7114c481c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:32.194137 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69e334-ba04-4065-a7ec-10e682c30558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:32.195220 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69e334-ba04-4065-a7ec-10e682c30558 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.196108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69e334-ba04-4065-a7ec-10e682c30558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.196474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69e334-ba04-4065-a7ec-10e682c30558 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.209172 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69e334-ba04-4065-a7ec-10e682c30558 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:32.211371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69e334-ba04-4065-a7ec-10e682c30558 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:32.230037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-3b69e334-ba04-4065-a7ec-10e682c30558 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:32.231834 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 614/1222] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:32.237429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d1622-45e6-4b9b-bb19-d9d486ab8093 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:32.249507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d1622-45e6-4b9b-bb19-d9d486ab8093 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:32.254722 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a816c-b906-4988-af82-3c48714e6486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:32.255370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a816c-b906-4988-af82-3c48714e6486 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.255652 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a816c-b906-4988-af82-3c48714e6486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.255925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a816c-b906-4988-af82-3c48714e6486 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.256783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a816c-b906-4988-af82-3c48714e6486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:32.257093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a816c-b906-4988-af82-3c48714e6486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:32.259289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a816c-b906-4988-af82-3c48714e6486 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:32.400076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 609/1223] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:32.405757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69e334-ba04-4065-a7ec-10e682c30558 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:32.417919 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69e334-ba04-4065-a7ec-10e682c30558 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:32.421404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3677c-0d7d-4fd8-9c40-b5e3276a09cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:32.422334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3677c-0d7d-4fd8-9c40-b5e3276a09cf admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.422688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3677c-0d7d-4fd8-9c40-b5e3276a09cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.423034 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3677c-0d7d-4fd8-9c40-b5e3276a09cf admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.431329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3677c-0d7d-4fd8-9c40-b5e3276a09cf admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:32.433349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3677c-0d7d-4fd8-9c40-b5e3276a09cf admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:32.447203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-77c3677c-0d7d-4fd8-9c40-b5e3276a09cf admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 01:28:32.448742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 615/1224] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:32.455362 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a816c-b906-4988-af82-3c48714e6486 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:32.466734 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a816c-b906-4988-af82-3c48714e6486 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:32.481977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a4064-6bb6-4a57-b5de-e63b55d5866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:32.482714 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a4064-6bb6-4a57-b5de-e63b55d5866a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.482996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a4064-6bb6-4a57-b5de-e63b55d5866a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.483268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a4064-6bb6-4a57-b5de-e63b55d5866a admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.484139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a4064-6bb6-4a57-b5de-e63b55d5866a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:32.484448 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a4064-6bb6-4a57-b5de-e63b55d5866a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:32.486458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a4064-6bb6-4a57-b5de-e63b55d5866a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:32.506536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 610/1225] 10.222.0.79 () {56 vars in 1164 bytes} [Mon Feb 21 01:28:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:32.512881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3677c-0d7d-4fd8-9c40-b5e3276a09cf admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:32.523041 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3677c-0d7d-4fd8-9c40-b5e3276a09cf admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:32.528275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214784a-6a19-44c7-ae0d-bae33bd6ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:32.529084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214784a-6a19-44c7-ae0d-bae33bd6ee7d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.529362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214784a-6a19-44c7-ae0d-bae33bd6ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.529631 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214784a-6a19-44c7-ae0d-bae33bd6ee7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.542121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214784a-6a19-44c7-ae0d-bae33bd6ee7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:32.544020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214784a-6a19-44c7-ae0d-bae33bd6ee7d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:32.561627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-5214784a-6a19-44c7-ae0d-bae33bd6ee7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:32.562932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 616/1226] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:32.568916 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a4064-6bb6-4a57-b5de-e63b55d5866a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:32.579556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a4064-6bb6-4a57-b5de-e63b55d5866a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:32.584780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10f2b0-2719-4ce1-bc33-387574ec2ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:32.585486 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10f2b0-2719-4ce1-bc33-387574ec2ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.586444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10f2b0-2719-4ce1-bc33-387574ec2ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.589544 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10f2b0-2719-4ce1-bc33-387574ec2ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.590588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10f2b0-2719-4ce1-bc33-387574ec2ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:32.590994 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10f2b0-2719-4ce1-bc33-387574ec2ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:32.593163 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10f2b0-2719-4ce1-bc33-387574ec2ad0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:32.607316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 611/1227] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:32.613055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214784a-6a19-44c7-ae0d-bae33bd6ee7d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:32.625031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214784a-6a19-44c7-ae0d-bae33bd6ee7d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:32.630328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72600170-8c76-4b95-ab20-3066e88bb61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:32.633042 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72600170-8c76-4b95-ab20-3066e88bb61a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.633042 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72600170-8c76-4b95-ab20-3066e88bb61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.633042 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72600170-8c76-4b95-ab20-3066e88bb61a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.640159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72600170-8c76-4b95-ab20-3066e88bb61a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:32.642096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72600170-8c76-4b95-ab20-3066e88bb61a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:32.656531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-72600170-8c76-4b95-ab20-3066e88bb61a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:28:32.657860 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 617/1228] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:32.663404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10f2b0-2719-4ce1-bc33-387574ec2ad0 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:32.673558 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10f2b0-2719-4ce1-bc33-387574ec2ad0 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:32.679085 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dd15e-1360-4258-9cbf-d21bc370ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:32.679989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dd15e-1360-4258-9cbf-d21bc370ac03 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.680443 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dd15e-1360-4258-9cbf-d21bc370ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.680848 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dd15e-1360-4258-9cbf-d21bc370ac03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.681768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dd15e-1360-4258-9cbf-d21bc370ac03 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:32.682194 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dd15e-1360-4258-9cbf-d21bc370ac03 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:32.684493 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dd15e-1360-4258-9cbf-d21bc370ac03 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:32.703663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 612/1229] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:32.705038 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72600170-8c76-4b95-ab20-3066e88bb61a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:32.716463 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72600170-8c76-4b95-ab20-3066e88bb61a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:32.722418 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d596498-efd3-429c-bfe5-63914066a5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:32.723378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d596498-efd3-429c-bfe5-63914066a5e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:32.723703 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d596498-efd3-429c-bfe5-63914066a5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:32.723977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d596498-efd3-429c-bfe5-63914066a5e3 admin admin] PATH_INFO: `/v3/projects/0eaab085a52a4171be0afec37707daca/users/02e7385005924d4f8c220c986b9866de/roles/8a020c6e5d94457ca1f453a3531c89b2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:32.741005 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d596498-efd3-429c-bfe5-63914066a5e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaab085a52a4171be0afec37707daca, user_id=02e7385005924d4f8c220c986b9866de, role_id=8a020c6e5d94457ca1f453a3531c89b2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:32.743726 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d596498-efd3-429c-bfe5-63914066a5e3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:32.757343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 618/1230] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:28:32 2022] PUT /identity/v3/projects/0eaab085a52a4171be0afec37707daca/users/02e7385005924d4f8c220c986b9866de/roles/8a020c6e5d94457ca1f453a3531c89b2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:28:35.217108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116c4a4-1c11-4533-a894-627ed876304f None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.217664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116c4a4-1c11-4533-a894-627ed876304f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.217664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116c4a4-1c11-4533-a894-627ed876304f None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.219440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 613/1231] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:28:35.225132 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13322465-692c-4046-80c0-2218e3da6a7f None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.225563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13322465-692c-4046-80c0-2218e3da6a7f None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.225708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13322465-692c-4046-80c0-2218e3da6a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.244286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-13322465-692c-4046-80c0-2218e3da6a7f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:35.245698 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-13322465-692c-4046-80c0-2218e3da6a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:35.310581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 619/1232] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:28:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:35.333844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116c4a4-1c11-4533-a894-627ed876304f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:35.347551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116c4a4-1c11-4533-a894-627ed876304f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:35.353516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071221d-f32b-4053-ae11-49d617dcc372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:35.354487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071221d-f32b-4053-ae11-49d617dcc372 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.354766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071221d-f32b-4053-ae11-49d617dcc372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.355063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071221d-f32b-4053-ae11-49d617dcc372 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.367292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071221d-f32b-4053-ae11-49d617dcc372 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:28:35.375059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-a071221d-f32b-4053-ae11-49d617dcc372 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:28:35.376737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 614/1233] 10.222.0.79 () {56 vars in 1123 bytes} [Mon Feb 21 01:28:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:35.382767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13322465-692c-4046-80c0-2218e3da6a7f None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:35.391800 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13322465-692c-4046-80c0-2218e3da6a7f None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:35.396470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53e58a-1239-4f0f-880c-b67bff6c68b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:35.397167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e58a-1239-4f0f-880c-b67bff6c68b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.397471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e58a-1239-4f0f-880c-b67bff6c68b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.397730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e58a-1239-4f0f-880c-b67bff6c68b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.399012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53e58a-1239-4f0f-880c-b67bff6c68b9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:35.399321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53e58a-1239-4f0f-880c-b67bff6c68b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:35.400943 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53e58a-1239-4f0f-880c-b67bff6c68b9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:35.409403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 620/1234] 10.222.0.79 () {56 vars in 1124 bytes} [Mon Feb 21 01:28:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:35.415758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071221d-f32b-4053-ae11-49d617dcc372 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:35.426567 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071221d-f32b-4053-ae11-49d617dcc372 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:35.431117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0af936-e3a1-4697-b897-afe10e5ff32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:35.431945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0af936-e3a1-4697-b897-afe10e5ff32d admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.432234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0af936-e3a1-4697-b897-afe10e5ff32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.432536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0af936-e3a1-4697-b897-afe10e5ff32d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.444744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0af936-e3a1-4697-b897-afe10e5ff32d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:35.447045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0af936-e3a1-4697-b897-afe10e5ff32d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:35.465782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-da0af936-e3a1-4697-b897-afe10e5ff32d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:35.467324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 615/1235] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:35.473585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53e58a-1239-4f0f-880c-b67bff6c68b9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:35.484919 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53e58a-1239-4f0f-880c-b67bff6c68b9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:35.490977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71de64-c953-481a-97f4-84bf6c4d4571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:35.491851 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71de64-c953-481a-97f4-84bf6c4d4571 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.492132 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71de64-c953-481a-97f4-84bf6c4d4571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.492646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71de64-c953-481a-97f4-84bf6c4d4571 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.493473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71de64-c953-481a-97f4-84bf6c4d4571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:35.493780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71de64-c953-481a-97f4-84bf6c4d4571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:35.495902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71de64-c953-481a-97f4-84bf6c4d4571 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:35.515738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 621/1236] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:35.517274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0af936-e3a1-4697-b897-afe10e5ff32d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:35.528093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0af936-e3a1-4697-b897-afe10e5ff32d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:35.533178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25053122-75dd-43a2-b17c-edef158661ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:35.534128 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25053122-75dd-43a2-b17c-edef158661ad admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.534449 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25053122-75dd-43a2-b17c-edef158661ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.534723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25053122-75dd-43a2-b17c-edef158661ad admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.543364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25053122-75dd-43a2-b17c-edef158661ad admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:35.545602 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25053122-75dd-43a2-b17c-edef158661ad admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:35.560682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-25053122-75dd-43a2-b17c-edef158661ad admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 01:28:35.562239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 616/1237] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:35.568756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71de64-c953-481a-97f4-84bf6c4d4571 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:35.579673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71de64-c953-481a-97f4-84bf6c4d4571 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:35.584592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800cf70-4cc0-4a83-a59b-fa91aa992ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:35.585281 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800cf70-4cc0-4a83-a59b-fa91aa992ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.585584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800cf70-4cc0-4a83-a59b-fa91aa992ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.585927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800cf70-4cc0-4a83-a59b-fa91aa992ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.587135 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800cf70-4cc0-4a83-a59b-fa91aa992ce6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:35.587523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800cf70-4cc0-4a83-a59b-fa91aa992ce6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:35.589808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800cf70-4cc0-4a83-a59b-fa91aa992ce6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:35.610181 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 622/1238] 10.222.0.79 () {56 vars in 1164 bytes} [Mon Feb 21 01:28:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:35.619428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25053122-75dd-43a2-b17c-edef158661ad admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:35.630144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25053122-75dd-43a2-b17c-edef158661ad admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:35.635257 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9f3c7-0418-4b5d-a9c7-0e7c5ac9927e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:35.636019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9f3c7-0418-4b5d-a9c7-0e7c5ac9927e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.636301 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9f3c7-0418-4b5d-a9c7-0e7c5ac9927e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.636570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9f3c7-0418-4b5d-a9c7-0e7c5ac9927e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.645220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9f3c7-0418-4b5d-a9c7-0e7c5ac9927e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:35.646999 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9f3c7-0418-4b5d-a9c7-0e7c5ac9927e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:35.656600 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 617/1239] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:28:35 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:28:35.662882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800cf70-4cc0-4a83-a59b-fa91aa992ce6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:35.674025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800cf70-4cc0-4a83-a59b-fa91aa992ce6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:35.678860 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616dd23-af7f-4c19-ad33-7cf4660294e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:35.680185 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616dd23-af7f-4c19-ad33-7cf4660294e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.680462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616dd23-af7f-4c19-ad33-7cf4660294e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.680730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616dd23-af7f-4c19-ad33-7cf4660294e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.691204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616dd23-af7f-4c19-ad33-7cf4660294e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:35.693241 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616dd23-af7f-4c19-ad33-7cf4660294e0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:35.712115 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-2616dd23-af7f-4c19-ad33-7cf4660294e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:35.713389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 623/1240] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:35.719224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9f3c7-0418-4b5d-a9c7-0e7c5ac9927e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:35.728467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9f3c7-0418-4b5d-a9c7-0e7c5ac9927e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:35.732984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0714c82-1796-4106-b719-672af4aae37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:35.733625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0714c82-1796-4106-b719-672af4aae37f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.733945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0714c82-1796-4106-b719-672af4aae37f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.734176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0714c82-1796-4106-b719-672af4aae37f admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.735018 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0714c82-1796-4106-b719-672af4aae37f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:35.735395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0714c82-1796-4106-b719-672af4aae37f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:35.737186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0714c82-1796-4106-b719-672af4aae37f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:35.751027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 618/1241] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:28:35.757278 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616dd23-af7f-4c19-ad33-7cf4660294e0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:35.767544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616dd23-af7f-4c19-ad33-7cf4660294e0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:35.772882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec26f6b-8a6c-431e-b2dc-be3808099735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:35.773650 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec26f6b-8a6c-431e-b2dc-be3808099735 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.773927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec26f6b-8a6c-431e-b2dc-be3808099735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.774292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec26f6b-8a6c-431e-b2dc-be3808099735 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.781346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec26f6b-8a6c-431e-b2dc-be3808099735 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:35.783332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec26f6b-8a6c-431e-b2dc-be3808099735 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:35.796567 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-2ec26f6b-8a6c-431e-b2dc-be3808099735 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:28:35.797770 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 624/1242] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:35.804910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0714c82-1796-4106-b719-672af4aae37f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:35.814419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0714c82-1796-4106-b719-672af4aae37f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:35.819575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940623-1998-45c7-8844-b53998b4b9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:35.820352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940623-1998-45c7-8844-b53998b4b9cf admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.820640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940623-1998-45c7-8844-b53998b4b9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.820928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940623-1998-45c7-8844-b53998b4b9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.821865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94940623-1998-45c7-8844-b53998b4b9cf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:35.822270 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94940623-1998-45c7-8844-b53998b4b9cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:35.824312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94940623-1998-45c7-8844-b53998b4b9cf admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:35.837174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 619/1243] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:28:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:35.843661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec26f6b-8a6c-431e-b2dc-be3808099735 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:35.855266 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec26f6b-8a6c-431e-b2dc-be3808099735 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:35.860059 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7c9a6-43d0-4d58-a245-bc81b86b8351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:35.860742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7c9a6-43d0-4d58-a245-bc81b86b8351 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:35.860974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7c9a6-43d0-4d58-a245-bc81b86b8351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:35.861241 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7c9a6-43d0-4d58-a245-bc81b86b8351 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:35.862060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7c9a6-43d0-4d58-a245-bc81b86b8351 admin admin] RBAC: Adding query filter params (role.id=8a020c6e5d94457ca1f453a3531c89b2, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=02e7385005924d4f8c220c986b9866de) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:35.862402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7c9a6-43d0-4d58-a245-bc81b86b8351 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:35.864224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7c9a6-43d0-4d58-a245-bc81b86b8351 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:35.870843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 625/1244] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:28:35 2022] GET /identity/v3/role_assignments?user.id=02e7385005924d4f8c220c986b9866de&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=8a020c6e5d94457ca1f453a3531c89b2 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:28:38.426867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0d47b-f10e-41f3-90da-146157af8fcc None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.427458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0d47b-f10e-41f3-90da-146157af8fcc None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.427458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0d47b-f10e-41f3-90da-146157af8fcc None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.429131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 620/1245] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:28:38.434875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22ca9-5529-416b-a94f-f2399c108e3e None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.435613 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22ca9-5529-416b-a94f-f2399c108e3e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.435613 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22ca9-5529-416b-a94f-f2399c108e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.453736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-cce22ca9-5529-416b-a94f-f2399c108e3e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:38.454938 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-cce22ca9-5529-416b-a94f-f2399c108e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:38.463336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 626/1246] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:28:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:38.487483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0d47b-f10e-41f3-90da-146157af8fcc None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:38.500516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0d47b-f10e-41f3-90da-146157af8fcc None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:38.504774 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d00ed-3306-4fd6-b7b6-1f4ec3136f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:38.505548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d00ed-3306-4fd6-b7b6-1f4ec3136f9e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.505824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d00ed-3306-4fd6-b7b6-1f4ec3136f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.506093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d00ed-3306-4fd6-b7b6-1f4ec3136f9e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.516283 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d00ed-3306-4fd6-b7b6-1f4ec3136f9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:28:38.522978 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-db7d00ed-3306-4fd6-b7b6-1f4ec3136f9e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:28:38.524150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 621/1247] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:38.530142 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce22ca9-5529-416b-a94f-f2399c108e3e None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:38.539908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce22ca9-5529-416b-a94f-f2399c108e3e None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:38.544847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a973eb6-44d0-4901-8bc6-0ec5512eb8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:38.545505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a973eb6-44d0-4901-8bc6-0ec5512eb8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.545791 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a973eb6-44d0-4901-8bc6-0ec5512eb8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.546065 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a973eb6-44d0-4901-8bc6-0ec5512eb8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.546889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a973eb6-44d0-4901-8bc6-0ec5512eb8d9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:38.547195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a973eb6-44d0-4901-8bc6-0ec5512eb8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:38.548790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a973eb6-44d0-4901-8bc6-0ec5512eb8d9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:38.557879 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 627/1248] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:38.563698 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d00ed-3306-4fd6-b7b6-1f4ec3136f9e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:38.574311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d00ed-3306-4fd6-b7b6-1f4ec3136f9e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:38.579500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f868fc-7bcf-4c30-ac46-24c19f072d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:38.580276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f868fc-7bcf-4c30-ac46-24c19f072d22 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.580552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f868fc-7bcf-4c30-ac46-24c19f072d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.580819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f868fc-7bcf-4c30-ac46-24c19f072d22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.592093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f868fc-7bcf-4c30-ac46-24c19f072d22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:38.594189 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f868fc-7bcf-4c30-ac46-24c19f072d22 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:38.615999 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-a8f868fc-7bcf-4c30-ac46-24c19f072d22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:38.617291 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 622/1249] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:38.625910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a973eb6-44d0-4901-8bc6-0ec5512eb8d9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:38.636577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a973eb6-44d0-4901-8bc6-0ec5512eb8d9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:38.643790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de91d4-a917-45a9-8e98-2460cc1ae0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:38.644463 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de91d4-a917-45a9-8e98-2460cc1ae0df admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.644750 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de91d4-a917-45a9-8e98-2460cc1ae0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.645029 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de91d4-a917-45a9-8e98-2460cc1ae0df admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.645761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de91d4-a917-45a9-8e98-2460cc1ae0df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:38.646066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de91d4-a917-45a9-8e98-2460cc1ae0df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:38.647941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de91d4-a917-45a9-8e98-2460cc1ae0df admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:38.662697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 628/1250] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:38.670413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f868fc-7bcf-4c30-ac46-24c19f072d22 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:38.684100 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f868fc-7bcf-4c30-ac46-24c19f072d22 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:38.689616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a56dd-2215-402a-952d-07f90ddf0cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:38.690489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a56dd-2215-402a-952d-07f90ddf0cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.690839 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a56dd-2215-402a-952d-07f90ddf0cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.691160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a56dd-2215-402a-952d-07f90ddf0cf6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.703285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a56dd-2215-402a-952d-07f90ddf0cf6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:38.705549 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a56dd-2215-402a-952d-07f90ddf0cf6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:38.722821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-c57a56dd-2215-402a-952d-07f90ddf0cf6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 01:28:38.724012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 623/1251] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:38.730736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de91d4-a917-45a9-8e98-2460cc1ae0df admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:38.741361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de91d4-a917-45a9-8e98-2460cc1ae0df admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:38.746867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1887d-2169-4682-914c-324cc2ec6bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:38.747529 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1887d-2169-4682-914c-324cc2ec6bda admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.748061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1887d-2169-4682-914c-324cc2ec6bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.748328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1887d-2169-4682-914c-324cc2ec6bda admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.749168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1887d-2169-4682-914c-324cc2ec6bda admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:38.749454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1887d-2169-4682-914c-324cc2ec6bda admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:38.751304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1887d-2169-4682-914c-324cc2ec6bda admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:38.769149 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 629/1252] 10.222.0.79 () {56 vars in 1164 bytes} [Mon Feb 21 01:28:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:38.774959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a56dd-2215-402a-952d-07f90ddf0cf6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:38.785565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a56dd-2215-402a-952d-07f90ddf0cf6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:38.792232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1561c5-7915-4b31-af9b-a5b5446d0bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:38.793137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1561c5-7915-4b31-af9b-a5b5446d0bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.793617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1561c5-7915-4b31-af9b-a5b5446d0bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.794082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1561c5-7915-4b31-af9b-a5b5446d0bf2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.803274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1561c5-7915-4b31-af9b-a5b5446d0bf2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:38.806166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1561c5-7915-4b31-af9b-a5b5446d0bf2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:38.823397 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 624/1253] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:28:38 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:28:38.824807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1887d-2169-4682-914c-324cc2ec6bda admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:38.835042 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1887d-2169-4682-914c-324cc2ec6bda admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:38.840222 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d664a-e4f9-40cb-ba41-6658eaf4ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:38.841162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d664a-e4f9-40cb-ba41-6658eaf4ec2a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.841429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d664a-e4f9-40cb-ba41-6658eaf4ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.841700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d664a-e4f9-40cb-ba41-6658eaf4ec2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.854187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d664a-e4f9-40cb-ba41-6658eaf4ec2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:38.856360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d664a-e4f9-40cb-ba41-6658eaf4ec2a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:38.874863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-049d664a-e4f9-40cb-ba41-6658eaf4ec2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:38.876200 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 630/1254] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:38.882930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1561c5-7915-4b31-af9b-a5b5446d0bf2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:38.893977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1561c5-7915-4b31-af9b-a5b5446d0bf2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:38.899774 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1921f9d-3202-4653-b046-13b379794ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:38.900727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1921f9d-3202-4653-b046-13b379794ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.900947 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1921f9d-3202-4653-b046-13b379794ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.901286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1921f9d-3202-4653-b046-13b379794ff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.902266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1921f9d-3202-4653-b046-13b379794ff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:38.902591 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1921f9d-3202-4653-b046-13b379794ff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:38.904432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1921f9d-3202-4653-b046-13b379794ff3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:38.919736 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 625/1255] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:38.925210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d664a-e4f9-40cb-ba41-6658eaf4ec2a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:38.936311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d664a-e4f9-40cb-ba41-6658eaf4ec2a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:38.941226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd44ebd-919d-4b7f-afed-92eb4fd83e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:38.942074 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd44ebd-919d-4b7f-afed-92eb4fd83e98 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.942390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd44ebd-919d-4b7f-afed-92eb4fd83e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.942671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd44ebd-919d-4b7f-afed-92eb4fd83e98 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.950349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd44ebd-919d-4b7f-afed-92eb4fd83e98 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:38.952294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd44ebd-919d-4b7f-afed-92eb4fd83e98 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:38.968224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-afd44ebd-919d-4b7f-afed-92eb4fd83e98 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:28:38.969813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 631/1256] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:28:38.976828 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1921f9d-3202-4653-b046-13b379794ff3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:38.987907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1921f9d-3202-4653-b046-13b379794ff3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:38.994230 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bbfa0-f4bd-4c5c-a97f-b2f2ebd2738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:38.995018 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bbfa0-f4bd-4c5c-a97f-b2f2ebd2738e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:38.995584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bbfa0-f4bd-4c5c-a97f-b2f2ebd2738e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:38.995866 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bbfa0-f4bd-4c5c-a97f-b2f2ebd2738e admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:38.996651 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bbfa0-f4bd-4c5c-a97f-b2f2ebd2738e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:38.996961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bbfa0-f4bd-4c5c-a97f-b2f2ebd2738e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:38.999355 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bbfa0-f4bd-4c5c-a97f-b2f2ebd2738e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:39.015283 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 626/1257] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:39.021730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd44ebd-919d-4b7f-afed-92eb4fd83e98 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:39.033332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd44ebd-919d-4b7f-afed-92eb4fd83e98 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:39.040483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b28f60-056b-4b25-92c2-aa782082b725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:39.041513 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b28f60-056b-4b25-92c2-aa782082b725 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:39.041894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b28f60-056b-4b25-92c2-aa782082b725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:39.042172 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b28f60-056b-4b25-92c2-aa782082b725 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:39.043026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b28f60-056b-4b25-92c2-aa782082b725 admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=02e7385005924d4f8c220c986b9866de) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:39.043559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b28f60-056b-4b25-92c2-aa782082b725 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:39.045600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b28f60-056b-4b25-92c2-aa782082b725 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:39.053375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 632/1258] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:28:39 2022] GET /identity/v3/role_assignments?user.id=02e7385005924d4f8c220c986b9866de&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=548abad662724741a3261205ee7cb828 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:28:41.437120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75015ae4-23c1-4765-a748-9dd3c73c8cdb None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.437644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75015ae4-23c1-4765-a748-9dd3c73c8cdb None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.437734 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75015ae4-23c1-4765-a748-9dd3c73c8cdb None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.439618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 627/1259] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:28:41.447414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affc369-f9a1-4df0-be19-acfb0f3030f0 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.447414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affc369-f9a1-4df0-be19-acfb0f3030f0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.447414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affc369-f9a1-4df0-be19-acfb0f3030f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.466363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-7affc369-f9a1-4df0-be19-acfb0f3030f0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:41.467622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7affc369-f9a1-4df0-be19-acfb0f3030f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:41.476828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 633/1260] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:28:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:41.502079 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75015ae4-23c1-4765-a748-9dd3c73c8cdb None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:41.515145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75015ae4-23c1-4765-a748-9dd3c73c8cdb None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:41.520392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa2d1d-7720-46a5-8189-0f78e2141c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:41.521637 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa2d1d-7720-46a5-8189-0f78e2141c02 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.521921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa2d1d-7720-46a5-8189-0f78e2141c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.522195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa2d1d-7720-46a5-8189-0f78e2141c02 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.534064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa2d1d-7720-46a5-8189-0f78e2141c02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:28:41.541466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-37aa2d1d-7720-46a5-8189-0f78e2141c02 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:28:41.542786 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 628/1261] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:41.549291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affc369-f9a1-4df0-be19-acfb0f3030f0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:41.558410 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affc369-f9a1-4df0-be19-acfb0f3030f0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:41.563457 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b304f-a715-4dbf-a063-753fff52b7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:41.564145 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b304f-a715-4dbf-a063-753fff52b7fa admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.564428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b304f-a715-4dbf-a063-753fff52b7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.564704 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b304f-a715-4dbf-a063-753fff52b7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.565464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b304f-a715-4dbf-a063-753fff52b7fa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:41.565771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b304f-a715-4dbf-a063-753fff52b7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:41.567413 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b304f-a715-4dbf-a063-753fff52b7fa admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:41.577207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 634/1262] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:41.583129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa2d1d-7720-46a5-8189-0f78e2141c02 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:41.596215 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa2d1d-7720-46a5-8189-0f78e2141c02 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:41.602382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff8f1f-4934-4930-a97f-cb5084ed08c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:41.603166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff8f1f-4934-4930-a97f-cb5084ed08c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.603454 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff8f1f-4934-4930-a97f-cb5084ed08c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.603701 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff8f1f-4934-4930-a97f-cb5084ed08c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.614775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff8f1f-4934-4930-a97f-cb5084ed08c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:41.616655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff8f1f-4934-4930-a97f-cb5084ed08c6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:41.637618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-54ff8f1f-4934-4930-a97f-cb5084ed08c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:41.638865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 629/1263] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:41.644860 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b304f-a715-4dbf-a063-753fff52b7fa admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:41.657709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b304f-a715-4dbf-a063-753fff52b7fa admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:41.662615 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16de91-eba3-4555-837b-27e8ac8beedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:41.663312 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16de91-eba3-4555-837b-27e8ac8beedd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.663609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16de91-eba3-4555-837b-27e8ac8beedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.663859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16de91-eba3-4555-837b-27e8ac8beedd admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.664578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16de91-eba3-4555-837b-27e8ac8beedd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:41.664882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16de91-eba3-4555-837b-27e8ac8beedd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:41.666654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16de91-eba3-4555-837b-27e8ac8beedd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:41.679383 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 635/1264] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:41.685363 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff8f1f-4934-4930-a97f-cb5084ed08c6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:41.696037 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff8f1f-4934-4930-a97f-cb5084ed08c6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:41.701214 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483cec8-4ace-4142-8a96-5f8c0da7ed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:41.702031 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483cec8-4ace-4142-8a96-5f8c0da7ed84 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.702356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483cec8-4ace-4142-8a96-5f8c0da7ed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.702630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483cec8-4ace-4142-8a96-5f8c0da7ed84 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.710378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483cec8-4ace-4142-8a96-5f8c0da7ed84 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:41.712927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483cec8-4ace-4142-8a96-5f8c0da7ed84 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:41.727335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-7483cec8-4ace-4142-8a96-5f8c0da7ed84 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 01:28:41.728569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 630/1265] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:28:41.734507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16de91-eba3-4555-837b-27e8ac8beedd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:41.745818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16de91-eba3-4555-837b-27e8ac8beedd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:41.751149 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e7766-2f10-4492-a60d-fbf375eaa938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:41.751885 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e7766-2f10-4492-a60d-fbf375eaa938 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.752228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e7766-2f10-4492-a60d-fbf375eaa938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.752533 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e7766-2f10-4492-a60d-fbf375eaa938 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.753500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e7766-2f10-4492-a60d-fbf375eaa938 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:41.753892 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e7766-2f10-4492-a60d-fbf375eaa938 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:41.755976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e7766-2f10-4492-a60d-fbf375eaa938 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:41.776136 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 636/1266] 10.222.0.79 () {56 vars in 1164 bytes} [Mon Feb 21 01:28:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:41.782355 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483cec8-4ace-4142-8a96-5f8c0da7ed84 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:41.792616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483cec8-4ace-4142-8a96-5f8c0da7ed84 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:41.797228 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153f528-184d-4f5b-9fcd-179e89d7c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:41.798019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153f528-184d-4f5b-9fcd-179e89d7c2ff admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.798330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153f528-184d-4f5b-9fcd-179e89d7c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.798603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153f528-184d-4f5b-9fcd-179e89d7c2ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.809712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153f528-184d-4f5b-9fcd-179e89d7c2ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:41.811709 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153f528-184d-4f5b-9fcd-179e89d7c2ff admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:41.830460 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-5153f528-184d-4f5b-9fcd-179e89d7c2ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:41.831778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 631/1267] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:41.837860 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e7766-2f10-4492-a60d-fbf375eaa938 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:41.852087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e7766-2f10-4492-a60d-fbf375eaa938 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:41.856948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2230f20-6075-4b86-aa47-ef154f1013f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:41.857604 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2230f20-6075-4b86-aa47-ef154f1013f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.857885 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2230f20-6075-4b86-aa47-ef154f1013f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.858158 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2230f20-6075-4b86-aa47-ef154f1013f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.858910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2230f20-6075-4b86-aa47-ef154f1013f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:41.859214 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2230f20-6075-4b86-aa47-ef154f1013f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:41.860840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2230f20-6075-4b86-aa47-ef154f1013f6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:41.873036 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 637/1268] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:41.878588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153f528-184d-4f5b-9fcd-179e89d7c2ff admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:41.889235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153f528-184d-4f5b-9fcd-179e89d7c2ff admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:41.894554 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe249eb3-aa95-4559-9a07-d18ee2715e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:41.895488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe249eb3-aa95-4559-9a07-d18ee2715e9c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.895869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe249eb3-aa95-4559-9a07-d18ee2715e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.896216 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe249eb3-aa95-4559-9a07-d18ee2715e9c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.904069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe249eb3-aa95-4559-9a07-d18ee2715e9c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:41.905999 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe249eb3-aa95-4559-9a07-d18ee2715e9c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:41.919757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-fe249eb3-aa95-4559-9a07-d18ee2715e9c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:28:41.921027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 632/1269] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:28:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:41.927016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2230f20-6075-4b86-aa47-ef154f1013f6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:41.937056 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2230f20-6075-4b86-aa47-ef154f1013f6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:41.941706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccae9e-c037-4bfe-91ec-12891d315928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:41.942387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccae9e-c037-4bfe-91ec-12891d315928 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.942673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccae9e-c037-4bfe-91ec-12891d315928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.942949 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccae9e-c037-4bfe-91ec-12891d315928 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.943738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccae9e-c037-4bfe-91ec-12891d315928 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:41.944051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccae9e-c037-4bfe-91ec-12891d315928 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:41.945900 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccae9e-c037-4bfe-91ec-12891d315928 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:41.959514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 638/1270] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:28:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:41.966145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe249eb3-aa95-4559-9a07-d18ee2715e9c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:41.978708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe249eb3-aa95-4559-9a07-d18ee2715e9c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:41.983559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f58760-61f3-4d40-b9b9-328518e74e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:41.983722 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f58760-61f3-4d40-b9b9-328518e74e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:41.984680 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f58760-61f3-4d40-b9b9-328518e74e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:41.984680 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f58760-61f3-4d40-b9b9-328518e74e66 admin admin] PATH_INFO: `/v3/projects/0eaab085a52a4171be0afec37707daca/users/02e7385005924d4f8c220c986b9866de/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:41.986170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f58760-61f3-4d40-b9b9-328518e74e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaab085a52a4171be0afec37707daca, user_id=02e7385005924d4f8c220c986b9866de, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:41.989110 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f58760-61f3-4d40-b9b9-328518e74e66 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:42.003903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 633/1271] 10.222.0.79 () {58 vars in 1460 bytes} [Mon Feb 21 01:28:41 2022] PUT /identity/v3/projects/0eaab085a52a4171be0afec37707daca/users/02e7385005924d4f8c220c986b9866de/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:28:44.399630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b406e7e-5532-47d1-b753-09b327910ce4 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.400130 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b406e7e-5532-47d1-b753-09b327910ce4 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.400130 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b406e7e-5532-47d1-b753-09b327910ce4 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.401848 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 639/1272] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:28:44.406929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26339125-c030-4cb6-8d14-75cc7417b002 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.407343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26339125-c030-4cb6-8d14-75cc7417b002 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.407470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26339125-c030-4cb6-8d14-75cc7417b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.424632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-26339125-c030-4cb6-8d14-75cc7417b002 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:44.425788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-26339125-c030-4cb6-8d14-75cc7417b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:44.480679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 634/1273] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:28:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:44.505089 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b406e7e-5532-47d1-b753-09b327910ce4 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:44.516921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b406e7e-5532-47d1-b753-09b327910ce4 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:44.521218 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30753f5-6df3-4ba1-a867-ae819a92ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:44.521973 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30753f5-6df3-4ba1-a867-ae819a92ac03 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.522273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30753f5-6df3-4ba1-a867-ae819a92ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.522543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30753f5-6df3-4ba1-a867-ae819a92ac03 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.532259 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30753f5-6df3-4ba1-a867-ae819a92ac03 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:28:44.539497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-e30753f5-6df3-4ba1-a867-ae819a92ac03 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:28:44.540623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 640/1274] 10.222.0.79 () {56 vars in 1117 bytes} [Mon Feb 21 01:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:44.546229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26339125-c030-4cb6-8d14-75cc7417b002 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:44.555443 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26339125-c030-4cb6-8d14-75cc7417b002 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:44.559930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44e484-c671-4388-baa4-3b45155abb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:44.560574 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44e484-c671-4388-baa4-3b45155abb1b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.560856 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44e484-c671-4388-baa4-3b45155abb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.561127 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44e484-c671-4388-baa4-3b45155abb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.561900 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44e484-c671-4388-baa4-3b45155abb1b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:44.562224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44e484-c671-4388-baa4-3b45155abb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:44.563815 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44e484-c671-4388-baa4-3b45155abb1b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:44.571689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 635/1275] 10.222.0.79 () {56 vars in 1120 bytes} [Mon Feb 21 01:28:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:44.577082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30753f5-6df3-4ba1-a867-ae819a92ac03 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:44.587019 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30753f5-6df3-4ba1-a867-ae819a92ac03 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:44.592204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ded64-0653-44c5-a233-8d90b41ff3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:44.592994 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ded64-0653-44c5-a233-8d90b41ff3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.593313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ded64-0653-44c5-a233-8d90b41ff3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.593617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ded64-0653-44c5-a233-8d90b41ff3b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.605338 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ded64-0653-44c5-a233-8d90b41ff3b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:44.607575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ded64-0653-44c5-a233-8d90b41ff3b5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:44.629487 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-974ded64-0653-44c5-a233-8d90b41ff3b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:44.631376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 641/1276] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:44.637200 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44e484-c671-4388-baa4-3b45155abb1b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:44.647851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44e484-c671-4388-baa4-3b45155abb1b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:44.652612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add819f-c08c-4de7-8e90-f397fd25b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:44.653203 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add819f-c08c-4de7-8e90-f397fd25b8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.653709 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add819f-c08c-4de7-8e90-f397fd25b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.654236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add819f-c08c-4de7-8e90-f397fd25b8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.655611 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add819f-c08c-4de7-8e90-f397fd25b8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:44.656165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add819f-c08c-4de7-8e90-f397fd25b8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:44.657901 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add819f-c08c-4de7-8e90-f397fd25b8f4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:44.669983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 636/1277] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:44.675674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ded64-0653-44c5-a233-8d90b41ff3b5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:44.685894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ded64-0653-44c5-a233-8d90b41ff3b5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:44.690412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602145c3-3d05-4ab4-88c3-68649d63eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:44.691185 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602145c3-3d05-4ab4-88c3-68649d63eb59 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.691469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602145c3-3d05-4ab4-88c3-68649d63eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.691742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602145c3-3d05-4ab4-88c3-68649d63eb59 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.698853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602145c3-3d05-4ab4-88c3-68649d63eb59 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:44.700875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602145c3-3d05-4ab4-88c3-68649d63eb59 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:44.714507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-602145c3-3d05-4ab4-88c3-68649d63eb59 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 01:28:44.715609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 642/1278] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:44.721175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add819f-c08c-4de7-8e90-f397fd25b8f4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:44.730994 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add819f-c08c-4de7-8e90-f397fd25b8f4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:44.735384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45bf36-72c9-443c-a6e7-832d88a81a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:44.736031 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45bf36-72c9-443c-a6e7-832d88a81a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.736314 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45bf36-72c9-443c-a6e7-832d88a81a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.736588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45bf36-72c9-443c-a6e7-832d88a81a55 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.737412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45bf36-72c9-443c-a6e7-832d88a81a55 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:44.737718 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45bf36-72c9-443c-a6e7-832d88a81a55 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:44.739567 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45bf36-72c9-443c-a6e7-832d88a81a55 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:44.756728 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 637/1279] 10.222.0.79 () {56 vars in 1164 bytes} [Mon Feb 21 01:28:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:44.762243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602145c3-3d05-4ab4-88c3-68649d63eb59 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:44.771539 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602145c3-3d05-4ab4-88c3-68649d63eb59 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:44.776044 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb00e1-7841-4132-bb7a-5946229a7777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:44.776664 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb00e1-7841-4132-bb7a-5946229a7777 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.776946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb00e1-7841-4132-bb7a-5946229a7777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.777217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb00e1-7841-4132-bb7a-5946229a7777 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.784661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb00e1-7841-4132-bb7a-5946229a7777 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:44.786426 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb00e1-7841-4132-bb7a-5946229a7777 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:44.795574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 643/1280] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Feb 21 01:28:44 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:28:44.800737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45bf36-72c9-443c-a6e7-832d88a81a55 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:44.810539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45bf36-72c9-443c-a6e7-832d88a81a55 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:44.814952 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fadde-fee7-44b7-a9d0-7531b07cd9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:44.815703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fadde-fee7-44b7-a9d0-7531b07cd9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.815985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fadde-fee7-44b7-a9d0-7531b07cd9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.816258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fadde-fee7-44b7-a9d0-7531b07cd9e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.826019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50fadde-fee7-44b7-a9d0-7531b07cd9e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:44.827840 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50fadde-fee7-44b7-a9d0-7531b07cd9e2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:44.843762 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-d50fadde-fee7-44b7-a9d0-7531b07cd9e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:28:44.844852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 638/1281] 10.222.0.79 () {56 vars in 1129 bytes} [Mon Feb 21 01:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:44.849960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb00e1-7841-4132-bb7a-5946229a7777 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:44.859092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb00e1-7841-4132-bb7a-5946229a7777 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:44.863577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc330990-bec3-4f55-b3a9-ec5bd6800d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:44.864187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc330990-bec3-4f55-b3a9-ec5bd6800d52 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.864468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc330990-bec3-4f55-b3a9-ec5bd6800d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.864741 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc330990-bec3-4f55-b3a9-ec5bd6800d52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.865447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc330990-bec3-4f55-b3a9-ec5bd6800d52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:44.865749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc330990-bec3-4f55-b3a9-ec5bd6800d52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:44.867871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc330990-bec3-4f55-b3a9-ec5bd6800d52 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:44.879010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 644/1282] 10.222.0.79 () {56 vars in 1130 bytes} [Mon Feb 21 01:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:44.884142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fadde-fee7-44b7-a9d0-7531b07cd9e2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:44.893274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fadde-fee7-44b7-a9d0-7531b07cd9e2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:44.898272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2343510-40dd-4a74-a7fc-b2c97adeb54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:44.899007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2343510-40dd-4a74-a7fc-b2c97adeb54b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.899296 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2343510-40dd-4a74-a7fc-b2c97adeb54b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.899567 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2343510-40dd-4a74-a7fc-b2c97adeb54b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.906104 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2343510-40dd-4a74-a7fc-b2c97adeb54b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:44.907983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2343510-40dd-4a74-a7fc-b2c97adeb54b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:44.921097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING keystone.server.flask.application [None req-a2343510-40dd-4a74-a7fc-b2c97adeb54b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:28:44.922184 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 639/1283] 10.222.0.79 () {56 vars in 1132 bytes} [Mon Feb 21 01:28:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:44.927446 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc330990-bec3-4f55-b3a9-ec5bd6800d52 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:44.936962 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc330990-bec3-4f55-b3a9-ec5bd6800d52 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:44.945266 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489e4ed-3968-4657-b913-73068a30b3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:44.945890 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489e4ed-3968-4657-b913-73068a30b3fd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.946176 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489e4ed-3968-4657-b913-73068a30b3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.946492 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489e4ed-3968-4657-b913-73068a30b3fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.947346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489e4ed-3968-4657-b913-73068a30b3fd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:44.947662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489e4ed-3968-4657-b913-73068a30b3fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:44.949499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489e4ed-3968-4657-b913-73068a30b3fd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:44.961781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 645/1284] 10.222.0.79 () {56 vars in 1169 bytes} [Mon Feb 21 01:28:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:44.967498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2343510-40dd-4a74-a7fc-b2c97adeb54b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:44.977941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2343510-40dd-4a74-a7fc-b2c97adeb54b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:44.982336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909f652-e9b5-4f92-b49d-cc65ac93c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:44.982951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909f652-e9b5-4f92-b49d-cc65ac93c18e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:44.983228 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909f652-e9b5-4f92-b49d-cc65ac93c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:44.983495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909f652-e9b5-4f92-b49d-cc65ac93c18e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:44.984302 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909f652-e9b5-4f92-b49d-cc65ac93c18e admin admin] RBAC: Adding query filter params (role.id=548abad662724741a3261205ee7cb828, scope.project.id=0eaab085a52a4171be0afec37707daca, user.id=02e7385005924d4f8c220c986b9866de) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:44.984604 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909f652-e9b5-4f92-b49d-cc65ac93c18e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:44.986437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909f652-e9b5-4f92-b49d-cc65ac93c18e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:44.991935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 640/1285] 10.222.0.79 () {56 vars in 1395 bytes} [Mon Feb 21 01:28:44 2022] GET /identity/v3/role_assignments?user.id=02e7385005924d4f8c220c986b9866de&scope.project.id=0eaab085a52a4171be0afec37707daca&role.id=548abad662724741a3261205ee7cb828 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:47.261572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25243d43-a417-4dd1-880d-21ddbdf6527c None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:47.262087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25243d43-a417-4dd1-880d-21ddbdf6527c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:47.262175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25243d43-a417-4dd1-880d-21ddbdf6527c None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:47.263892 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 646/1286] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:28:47.268898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138de5c-4821-49b6-bde8-49ff0f6390ca None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:47.269326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138de5c-4821-49b6-bde8-49ff0f6390ca None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:47.269436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138de5c-4821-49b6-bde8-49ff0f6390ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:47.287151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2138de5c-4821-49b6-bde8-49ff0f6390ca None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:47.288938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2138de5c-4821-49b6-bde8-49ff0f6390ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:47.296679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 641/1287] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:28:47 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:47.318825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25243d43-a417-4dd1-880d-21ddbdf6527c None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:47.330712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25243d43-a417-4dd1-880d-21ddbdf6527c None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:47.335467 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b6a01-2f07-4e18-9284-19a16cb9d6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:47.336243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b6a01-2f07-4e18-9284-19a16cb9d6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:47.336519 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b6a01-2f07-4e18-9284-19a16cb9d6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:47.336782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b6a01-2f07-4e18-9284-19a16cb9d6d2 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:47.337420 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b6a01-2f07-4e18-9284-19a16cb9d6d2 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:47.339041 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b6a01-2f07-4e18-9284-19a16cb9d6d2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:47.349594 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-bb6b6a01-2f07-4e18-9284-19a16cb9d6d2 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 01:28:47.351266 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 647/1288] 10.222.0.79 () {56 vars in 1138 bytes} [Mon Feb 21 01:28:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:28:47.358902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138de5c-4821-49b6-bde8-49ff0f6390ca None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:47.370333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138de5c-4821-49b6-bde8-49ff0f6390ca None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:47.375107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a01c1b-8efe-4350-bfaa-883d8f15804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:47.375758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a01c1b-8efe-4350-bfaa-883d8f15804b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:47.376040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a01c1b-8efe-4350-bfaa-883d8f15804b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:47.376322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a01c1b-8efe-4350-bfaa-883d8f15804b admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:47.377030 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a01c1b-8efe-4350-bfaa-883d8f15804b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:47.377335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a01c1b-8efe-4350-bfaa-883d8f15804b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:47.378979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a01c1b-8efe-4350-bfaa-883d8f15804b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:47.383758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 642/1289] 10.222.0.79 () {56 vars in 1137 bytes} [Mon Feb 21 01:28:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:47.390053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b6a01-2f07-4e18-9284-19a16cb9d6d2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:47.399924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b6a01-2f07-4e18-9284-19a16cb9d6d2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:47.404394 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd1864-6446-45eb-8f29-1e8f047b82ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:47.405021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd1864-6446-45eb-8f29-1e8f047b82ca admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:47.405297 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd1864-6446-45eb-8f29-1e8f047b82ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:47.405567 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd1864-6446-45eb-8f29-1e8f047b82ca admin admin] PATH_INFO: `/v3/services` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:47.406289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd1864-6446-45eb-8f29-1e8f047b82ca admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:47.406593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd1864-6446-45eb-8f29-1e8f047b82ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:47.408156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd1864-6446-45eb-8f29-1e8f047b82ca admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:47.412372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 648/1290] 10.222.0.79 () {56 vars in 1137 bytes} [Mon Feb 21 01:28:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:28:49.704935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b3b30-e995-4deb-b5fe-3d4445fec087 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:49.705466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b3b30-e995-4deb-b5fe-3d4445fec087 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:49.705560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b3b30-e995-4deb-b5fe-3d4445fec087 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:49.707300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 643/1291] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:28:49.713135 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c85206-e267-40f1-9aba-c007c3ba39c5 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:49.713726 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c85206-e267-40f1-9aba-c007c3ba39c5 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:49.714374 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c85206-e267-40f1-9aba-c007c3ba39c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:49.734910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-f1c85206-e267-40f1-9aba-c007c3ba39c5 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:49.736191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f1c85206-e267-40f1-9aba-c007c3ba39c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:49.746093 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 649/1292] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:28:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:49.770466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b3b30-e995-4deb-b5fe-3d4445fec087 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:49.782174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b3b30-e995-4deb-b5fe-3d4445fec087 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:49.786415 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f39d7a-2601-4740-9ab4-850555865b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:49.787059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f39d7a-2601-4740-9ab4-850555865b8d admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:49.787339 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f39d7a-2601-4740-9ab4-850555865b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:49.787608 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f39d7a-2601-4740-9ab4-850555865b8d admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:49.788830 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f39d7a-2601-4740-9ab4-850555865b8d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:49.790426 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f39d7a-2601-4740-9ab4-850555865b8d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:49.802703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 644/1293] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Feb 21 01:28:49 2022] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:28:52.065268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c82d-5d0a-4fc1-89c0-d99add23cfdf None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:52.065795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c82d-5d0a-4fc1-89c0-d99add23cfdf None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:52.065795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c82d-5d0a-4fc1-89c0-d99add23cfdf None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:52.068685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 650/1294] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:28:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:28:52.074702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06c49-3408-4f05-ba67-c23113e6bbb1 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:52.075143 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06c49-3408-4f05-ba67-c23113e6bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:52.075263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06c49-3408-4f05-ba67-c23113e6bbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:52.093203 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-78d06c49-3408-4f05-ba67-c23113e6bbb1 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:52.094411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-78d06c49-3408-4f05-ba67-c23113e6bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:52.110884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 645/1295] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:52.134421 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8c82d-5d0a-4fc1-89c0-d99add23cfdf None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:52.146221 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8c82d-5d0a-4fc1-89c0-d99add23cfdf None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:52.151104 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93cc4e-ecc8-4424-a4db-1c156ef74557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:52.151866 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93cc4e-ecc8-4424-a4db-1c156ef74557 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:52.152143 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93cc4e-ecc8-4424-a4db-1c156ef74557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:52.152414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93cc4e-ecc8-4424-a4db-1c156ef74557 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:52.153055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93cc4e-ecc8-4424-a4db-1c156ef74557 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:52.154676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93cc4e-ecc8-4424-a4db-1c156ef74557 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:52.165262 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-ab93cc4e-ecc8-4424-a4db-1c156ef74557 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 01:28:52.166392 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 651/1296] 10.222.0.79 () {56 vars in 1138 bytes} [Mon Feb 21 01:28:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:52.171943 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d06c49-3408-4f05-ba67-c23113e6bbb1 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:52.180535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d06c49-3408-4f05-ba67-c23113e6bbb1 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:52.185082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39280a16-6493-462a-9c59-792b9db5bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:52.185721 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39280a16-6493-462a-9c59-792b9db5bb45 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:52.186005 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39280a16-6493-462a-9c59-792b9db5bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:52.186313 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39280a16-6493-462a-9c59-792b9db5bb45 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:52.187022 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39280a16-6493-462a-9c59-792b9db5bb45 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:52.187330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39280a16-6493-462a-9c59-792b9db5bb45 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:52.188908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39280a16-6493-462a-9c59-792b9db5bb45 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:52.193983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 646/1297] 10.222.0.79 () {56 vars in 1137 bytes} [Mon Feb 21 01:28:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:28:52.199585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93cc4e-ecc8-4424-a4db-1c156ef74557 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:52.208570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93cc4e-ecc8-4424-a4db-1c156ef74557 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:52.213645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8dadde-fb5d-49aa-be5f-0a217610593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:52.214265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dadde-fb5d-49aa-be5f-0a217610593c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:52.214545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dadde-fb5d-49aa-be5f-0a217610593c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:52.214816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dadde-fb5d-49aa-be5f-0a217610593c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:52.215575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dadde-fb5d-49aa-be5f-0a217610593c admin admin] RBAC: Adding query filter params (interface=public, service_id=9c27030e04a6430da88ae1ec086aab83, region_id=RegionOne) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:52.215877 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dadde-fb5d-49aa-be5f-0a217610593c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:52.217396 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dadde-fb5d-49aa-be5f-0a217610593c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:52.222107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 652/1298] 10.222.0.79 () {56 vars in 1272 bytes} [Mon Feb 21 01:28:52 2022] GET /identity/v3/endpoints?service_id=9c27030e04a6430da88ae1ec086aab83&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:52.226897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39280a16-6493-462a-9c59-792b9db5bb45 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:52.236013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39280a16-6493-462a-9c59-792b9db5bb45 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:52.240472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d2a2b-a085-4cea-bde6-4429ea027374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:52.241088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d2a2b-a085-4cea-bde6-4429ea027374 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:52.241371 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d2a2b-a085-4cea-bde6-4429ea027374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:52.241645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d2a2b-a085-4cea-bde6-4429ea027374 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:52.242337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d2a2b-a085-4cea-bde6-4429ea027374 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:52.243938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d2a2b-a085-4cea-bde6-4429ea027374 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:52.250743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 647/1299] 10.222.0.79 () {56 vars in 1108 bytes} [Mon Feb 21 01:28:52 2022] GET /identity/v3/services => generated 2191 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:28:54.494581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93437953-97b1-456a-8bd8-d7332bbde251 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:54.495097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93437953-97b1-456a-8bd8-d7332bbde251 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:54.495216 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93437953-97b1-456a-8bd8-d7332bbde251 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:54.496890 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 653/1300] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:28:54.502306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f7ab0-910a-4658-9514-f58b14687320 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:54.502719 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f7ab0-910a-4658-9514-f58b14687320 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:54.502851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f7ab0-910a-4658-9514-f58b14687320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:54.520588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e30f7ab0-910a-4658-9514-f58b14687320 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:54.521740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e30f7ab0-910a-4658-9514-f58b14687320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:54.529192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 648/1301] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:54.552402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93437953-97b1-456a-8bd8-d7332bbde251 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:54.564948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93437953-97b1-456a-8bd8-d7332bbde251 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:54.569205 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc052ab-d921-4a36-91af-fb7321b3b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:54.569965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc052ab-d921-4a36-91af-fb7321b3b409 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:54.570277 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc052ab-d921-4a36-91af-fb7321b3b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:54.570553 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc052ab-d921-4a36-91af-fb7321b3b409 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:54.571198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc052ab-d921-4a36-91af-fb7321b3b409 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:54.572777 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc052ab-d921-4a36-91af-fb7321b3b409 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:54.583367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING keystone.server.flask.application [None req-1cc052ab-d921-4a36-91af-fb7321b3b409 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 01:28:54.584504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 654/1302] 10.222.0.79 () {56 vars in 1138 bytes} [Mon Feb 21 01:28:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:28:54.592056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f7ab0-910a-4658-9514-f58b14687320 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:54.601994 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f7ab0-910a-4658-9514-f58b14687320 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:54.606998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae03869-f824-450c-ac82-e5a5c54bb310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:54.607657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae03869-f824-450c-ac82-e5a5c54bb310 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:54.608009 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae03869-f824-450c-ac82-e5a5c54bb310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:54.608176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae03869-f824-450c-ac82-e5a5c54bb310 admin admin] PATH_INFO: `/v3/services` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:54.608871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae03869-f824-450c-ac82-e5a5c54bb310 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:54.609164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae03869-f824-450c-ac82-e5a5c54bb310 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:54.610884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae03869-f824-450c-ac82-e5a5c54bb310 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:54.616738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 649/1303] 10.222.0.79 () {56 vars in 1137 bytes} [Mon Feb 21 01:28:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:54.623060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc052ab-d921-4a36-91af-fb7321b3b409 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:54.635277 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc052ab-d921-4a36-91af-fb7321b3b409 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:54.640506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6142540-b00c-43ef-a36b-e70dfd0aed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:54.641148 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6142540-b00c-43ef-a36b-e70dfd0aed8e admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:54.641428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6142540-b00c-43ef-a36b-e70dfd0aed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:54.641696 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6142540-b00c-43ef-a36b-e70dfd0aed8e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:54.642454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6142540-b00c-43ef-a36b-e70dfd0aed8e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:54.644036 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6142540-b00c-43ef-a36b-e70dfd0aed8e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:54.662558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 655/1304] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Feb 21 01:28:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:29:58.410655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870deeca-1cf5-40bd-9ea5-2e98c081dab5 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:29:58.411565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870deeca-1cf5-40bd-9ea5-2e98c081dab5 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:29:58.411993 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870deeca-1cf5-40bd-9ea5-2e98c081dab5 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:29:58.419292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07aadb-36d9-4275-b46b-1b427a580f72 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:29:58.420061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07aadb-36d9-4275-b46b-1b427a580f72 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:29:58.420500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07aadb-36d9-4275-b46b-1b427a580f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:29:58.424009 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 650/1305] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:29:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:29:58.557065 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-6d07aadb-36d9-4275-b46b-1b427a580f72 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:29:58.558712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6d07aadb-36d9-4275-b46b-1b427a580f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:29:58.730609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 656/1306] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:29:58.753719 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870deeca-1cf5-40bd-9ea5-2e98c081dab5 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:29:58.756180 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-870deeca-1cf5-40bd-9ea5-2e98c081dab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:29:58.888329 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870deeca-1cf5-40bd-9ea5-2e98c081dab5 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:29:58.978838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897d6a8-b15a-4151-af7b-5ce7effe356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:29:58.979503 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897d6a8-b15a-4151-af7b-5ce7effe356b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:29:58.979792 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897d6a8-b15a-4151-af7b-5ce7effe356b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:29:58.980067 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897d6a8-b15a-4151-af7b-5ce7effe356b admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:29:58.980801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897d6a8-b15a-4151-af7b-5ce7effe356b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:29:58.982681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897d6a8-b15a-4151-af7b-5ce7effe356b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:29:59.001713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 651/1307] 10.222.0.79 () {56 vars in 1108 bytes} [Mon Feb 21 01:29:58 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:30:01.378415 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5abf07-8275-41ee-b651-e2304d04003d None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:01.378925 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5abf07-8275-41ee-b651-e2304d04003d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:01.378925 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5abf07-8275-41ee-b651-e2304d04003d None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:01.381211 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 657/1308] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:01.386419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7dd96-7ab5-45e5-b12f-588a9fa6aec7 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:01.386903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7dd96-7ab5-45e5-b12f-588a9fa6aec7 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:01.386986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7dd96-7ab5-45e5-b12f-588a9fa6aec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:01.466758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4dd7dd96-7ab5-45e5-b12f-588a9fa6aec7 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:01.467931 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4dd7dd96-7ab5-45e5-b12f-588a9fa6aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:01.566686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 652/1309] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:01.616422 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f7e3b-97e4-4d31-a158-69cf1e2a4ebc None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:01.616710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f7e3b-97e4-4d31-a158-69cf1e2a4ebc None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:01.616988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f7e3b-97e4-4d31-a158-69cf1e2a4ebc None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:01.619205 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 658/1310] 10.222.0.79 () {54 vars in 964 bytes} [Mon Feb 21 01:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:01.625384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e59cf-210b-4b5e-a82a-70d47b3a3fa3 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:01.625753 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e59cf-210b-4b5e-a82a-70d47b3a3fa3 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:01.626315 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e59cf-210b-4b5e-a82a-70d47b3a3fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:01.724816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-252e59cf-210b-4b5e-a82a-70d47b3a3fa3 None None] MFA Rules not processed for user `3f00b174c88547e2ab799d89a50d5b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:01.731572 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-252e59cf-210b-4b5e-a82a-70d47b3a3fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:01.813289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 653/1311] 10.222.0.79 () {58 vars in 1061 bytes} [Mon Feb 21 01:30:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:01.823736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f7e3b-97e4-4d31-a158-69cf1e2a4ebc None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:01.825294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0e3f7e3b-97e4-4d31-a158-69cf1e2a4ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:01.939535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f7e3b-97e4-4d31-a158-69cf1e2a4ebc None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:02.025596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4bf8e-f5ed-4e03-b6a2-80890db358cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:02.026289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4bf8e-f5ed-4e03-b6a2-80890db358cd service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:02.026574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4bf8e-f5ed-4e03-b6a2-80890db358cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:02.026850 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4bf8e-f5ed-4e03-b6a2-80890db358cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:02.028588 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-23e4bf8e-f5ed-4e03-b6a2-80890db358cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:02.152706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4bf8e-f5ed-4e03-b6a2-80890db358cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:02.154074 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4bf8e-f5ed-4e03-b6a2-80890db358cd service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:02.172827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 659/1312] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:04.763541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08161f92-b33a-49b9-9026-b473c44f62cb None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:04.764097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08161f92-b33a-49b9-9026-b473c44f62cb None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:04.764097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08161f92-b33a-49b9-9026-b473c44f62cb None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:04.765843 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 654/1313] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:04.770960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a994bdd-0b10-4b4a-9583-97f1994eaeb3 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:04.771394 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a994bdd-0b10-4b4a-9583-97f1994eaeb3 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:04.771522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a994bdd-0b10-4b4a-9583-97f1994eaeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:04.834982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-7a994bdd-0b10-4b4a-9583-97f1994eaeb3 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:04.836175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7a994bdd-0b10-4b4a-9583-97f1994eaeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:04.926875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 660/1314] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:04.964059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08161f92-b33a-49b9-9026-b473c44f62cb None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:04.965572 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-08161f92-b33a-49b9-9026-b473c44f62cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:05.064757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08161f92-b33a-49b9-9026-b473c44f62cb None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:05.135762 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a06b1-7619-4487-b4f1-de25c7ba6c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:05.136399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a06b1-7619-4487-b4f1-de25c7ba6c57 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:05.136677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a06b1-7619-4487-b4f1-de25c7ba6c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:05.136947 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a06b1-7619-4487-b4f1-de25c7ba6c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:05.138583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0e5a06b1-7619-4487-b4f1-de25c7ba6c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:05.240929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a06b1-7619-4487-b4f1-de25c7ba6c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:05.242398 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a06b1-7619-4487-b4f1-de25c7ba6c57 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:05.260961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 655/1315] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:07.863304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369dff2-f3cf-4a2c-87c0-17237b093ed4 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:07.863826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369dff2-f3cf-4a2c-87c0-17237b093ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:07.863923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369dff2-f3cf-4a2c-87c0-17237b093ed4 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:07.865630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 661/1316] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:07.870689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004eaf-3d48-416f-8f88-4b7fb0375995 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:07.871100 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004eaf-3d48-416f-8f88-4b7fb0375995 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:07.871244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004eaf-3d48-416f-8f88-4b7fb0375995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:07.933738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-d5004eaf-3d48-416f-8f88-4b7fb0375995 None None] MFA Rules not processed for user `afb1e9b4dc2b4c36880beab449c95d29`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:07.934928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d5004eaf-3d48-416f-8f88-4b7fb0375995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:08.027000 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 656/1317] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:08.068995 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369dff2-f3cf-4a2c-87c0-17237b093ed4 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:08.070582 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1369dff2-f3cf-4a2c-87c0-17237b093ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:08.167729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369dff2-f3cf-4a2c-87c0-17237b093ed4 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:08.236076 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfd3b7-d7da-456b-90ac-3e43f53a5978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:08.236720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfd3b7-d7da-456b-90ac-3e43f53a5978 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:08.237001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfd3b7-d7da-456b-90ac-3e43f53a5978 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:08.237274 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfd3b7-d7da-456b-90ac-3e43f53a5978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:08.239482 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-2dbfd3b7-d7da-456b-90ac-3e43f53a5978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:08.342174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfd3b7-d7da-456b-90ac-3e43f53a5978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:08.343628 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfd3b7-d7da-456b-90ac-3e43f53a5978 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:08.360743 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 662/1318] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:30:11.190177 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ab07b-602e-44cd-b372-541cdb8a3fff None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:11.190740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ab07b-602e-44cd-b372-541cdb8a3fff None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:11.190740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ab07b-602e-44cd-b372-541cdb8a3fff None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:11.193115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 657/1319] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:11.198361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5b032-c1bd-4670-b58d-19835a9a0c5c None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:11.198775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5b032-c1bd-4670-b58d-19835a9a0c5c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:11.198919 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5b032-c1bd-4670-b58d-19835a9a0c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:11.261967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-04e5b032-c1bd-4670-b58d-19835a9a0c5c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:11.263173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-04e5b032-c1bd-4670-b58d-19835a9a0c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:11.356409 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 663/1320] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:11.398991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ab07b-602e-44cd-b372-541cdb8a3fff None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:11.400500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-871ab07b-602e-44cd-b372-541cdb8a3fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:11.501403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ab07b-602e-44cd-b372-541cdb8a3fff None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:11.572260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a56b6-e8a5-4d7a-8f7a-3664626e8ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:11.572903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a56b6-e8a5-4d7a-8f7a-3664626e8ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:11.573182 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a56b6-e8a5-4d7a-8f7a-3664626e8ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:11.573462 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a56b6-e8a5-4d7a-8f7a-3664626e8ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:11.575144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5e3a56b6-e8a5-4d7a-8f7a-3664626e8ab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:11.680304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a56b6-e8a5-4d7a-8f7a-3664626e8ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:11.681744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a56b6-e8a5-4d7a-8f7a-3664626e8ab4 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:11.699255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 658/1321] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:30:14.639752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67195f-ff28-46d1-8969-dfa04815ecc3 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:14.640251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67195f-ff28-46d1-8969-dfa04815ecc3 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:14.640251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67195f-ff28-46d1-8969-dfa04815ecc3 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:14.641993 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 664/1322] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:14.647257 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828346a-4a04-4757-b9e0-8a153945088a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:14.647672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828346a-4a04-4757-b9e0-8a153945088a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:14.647932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828346a-4a04-4757-b9e0-8a153945088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:14.710084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f828346a-4a04-4757-b9e0-8a153945088a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:14.711283 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f828346a-4a04-4757-b9e0-8a153945088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:14.807258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 659/1323] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:14.843661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67195f-ff28-46d1-8969-dfa04815ecc3 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:14.845273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0d67195f-ff28-46d1-8969-dfa04815ecc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:14.944479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67195f-ff28-46d1-8969-dfa04815ecc3 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:15.015311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f2f1e-dd64-4625-93bb-6050950e2535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:15.015954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f2f1e-dd64-4625-93bb-6050950e2535 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:15.016233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f2f1e-dd64-4625-93bb-6050950e2535 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:15.016504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f2f1e-dd64-4625-93bb-6050950e2535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:15.018101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b03f2f1e-dd64-4625-93bb-6050950e2535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:15.127661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f2f1e-dd64-4625-93bb-6050950e2535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:15.129127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f2f1e-dd64-4625-93bb-6050950e2535 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:15.146736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 665/1324] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:17.492507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe250-4c34-4d79-aafd-bcafd3b9a26b None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:17.493064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe250-4c34-4d79-aafd-bcafd3b9a26b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:17.493064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe250-4c34-4d79-aafd-bcafd3b9a26b None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:17.494923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 660/1325] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:17.500454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b15b01-ffb6-4926-9f04-6827938ed311 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:17.500858 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b15b01-ffb6-4926-9f04-6827938ed311 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:17.501013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b15b01-ffb6-4926-9f04-6827938ed311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:17.566577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-48b15b01-ffb6-4926-9f04-6827938ed311 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:17.567779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-48b15b01-ffb6-4926-9f04-6827938ed311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:17.663163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 666/1326] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:17.715080 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66fc1-bf00-4964-bfe2-00c32bf9e6a6 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:17.715416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66fc1-bf00-4964-bfe2-00c32bf9e6a6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:17.715644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66fc1-bf00-4964-bfe2-00c32bf9e6a6 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:17.717461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 661/1327] 10.222.0.79 () {54 vars in 964 bytes} [Mon Feb 21 01:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:17.724552 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481da97d-f2b9-4639-b6b2-20092e5e97db None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:17.724918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481da97d-f2b9-4639-b6b2-20092e5e97db None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:17.725267 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481da97d-f2b9-4639-b6b2-20092e5e97db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:17.798243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-481da97d-f2b9-4639-b6b2-20092e5e97db None None] MFA Rules not processed for user `3f00b174c88547e2ab799d89a50d5b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:17.799351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-481da97d-f2b9-4639-b6b2-20092e5e97db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:17.875714 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 667/1328] 10.222.0.79 () {58 vars in 1061 bytes} [Mon Feb 21 01:30:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:17.885251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee66fc1-bf00-4964-bfe2-00c32bf9e6a6 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:17.886785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5ee66fc1-bf00-4964-bfe2-00c32bf9e6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:17.984252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee66fc1-bf00-4964-bfe2-00c32bf9e6a6 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:18.054582 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884a289-2a83-4d5a-b961-1698d40cad3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:18.055152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884a289-2a83-4d5a-b961-1698d40cad3c service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:18.055437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884a289-2a83-4d5a-b961-1698d40cad3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:18.055713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884a289-2a83-4d5a-b961-1698d40cad3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:18.057380 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8884a289-2a83-4d5a-b961-1698d40cad3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:18.164790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884a289-2a83-4d5a-b961-1698d40cad3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:18.166252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884a289-2a83-4d5a-b961-1698d40cad3c service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:18.184580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 662/1329] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:20.755278 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a6e85-1140-4104-a9e7-a9e5ebd72864 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:20.755828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a6e85-1140-4104-a9e7-a9e5ebd72864 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:20.755828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a6e85-1140-4104-a9e7-a9e5ebd72864 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:20.757771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 668/1330] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:20.762845 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e097410-e59c-4158-8ddc-9e7e7c591461 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:20.763369 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e097410-e59c-4158-8ddc-9e7e7c591461 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:20.763369 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e097410-e59c-4158-8ddc-9e7e7c591461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:20.828048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0e097410-e59c-4158-8ddc-9e7e7c591461 None None] MFA Rules not processed for user `afb1e9b4dc2b4c36880beab449c95d29`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:20.829214 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0e097410-e59c-4158-8ddc-9e7e7c591461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:20.926277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 663/1331] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:30:20.963384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a6e85-1140-4104-a9e7-a9e5ebd72864 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:20.964891 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-211a6e85-1140-4104-a9e7-a9e5ebd72864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:21.065369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a6e85-1140-4104-a9e7-a9e5ebd72864 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:21.137134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec185ab-895b-4d46-9bd5-0ea7f58659f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:21.137784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec185ab-895b-4d46-9bd5-0ea7f58659f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:21.138069 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec185ab-895b-4d46-9bd5-0ea7f58659f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:21.138375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec185ab-895b-4d46-9bd5-0ea7f58659f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:21.139998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-4ec185ab-895b-4d46-9bd5-0ea7f58659f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:21.247544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec185ab-895b-4d46-9bd5-0ea7f58659f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:21.248994 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec185ab-895b-4d46-9bd5-0ea7f58659f0 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:21.267066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 669/1332] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:23.987725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d4b5e-fda5-4774-bdfd-b93cb8d010a9 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:23.988196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d4b5e-fda5-4774-bdfd-b93cb8d010a9 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:23.988276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d4b5e-fda5-4774-bdfd-b93cb8d010a9 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:23.990005 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 664/1333] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:30:23.995344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fc5d4-ce20-4d6b-b3ed-573df29f74b0 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:23.995781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fc5d4-ce20-4d6b-b3ed-573df29f74b0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:23.995917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fc5d4-ce20-4d6b-b3ed-573df29f74b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:24.059327 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-1e0fc5d4-ce20-4d6b-b3ed-573df29f74b0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:24.060514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1e0fc5d4-ce20-4d6b-b3ed-573df29f74b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:24.157439 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 670/1334] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:24.194317 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d4b5e-fda5-4774-bdfd-b93cb8d010a9 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:24.195793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ba5d4b5e-fda5-4774-bdfd-b93cb8d010a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:24.300303 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d4b5e-fda5-4774-bdfd-b93cb8d010a9 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:24.370696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2bc40-b630-4046-a81e-aae5275622e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:24.371593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2bc40-b630-4046-a81e-aae5275622e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:24.371874 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2bc40-b630-4046-a81e-aae5275622e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:24.372144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2bc40-b630-4046-a81e-aae5275622e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:24.373759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-91b2bc40-b630-4046-a81e-aae5275622e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:24.492726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2bc40-b630-4046-a81e-aae5275622e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:24.494192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2bc40-b630-4046-a81e-aae5275622e6 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:24.512335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 665/1335] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:26.857304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6d6e5-5512-4863-9ab5-5494d4fcc44b None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:26.857843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6d6e5-5512-4863-9ab5-5494d4fcc44b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:26.857843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6d6e5-5512-4863-9ab5-5494d4fcc44b None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:26.859662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 671/1336] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:26.864945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8c8e-6352-4eb1-88ee-adaa8cbb838c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:26.865353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8c8e-6352-4eb1-88ee-adaa8cbb838c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:26.865491 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8c8e-6352-4eb1-88ee-adaa8cbb838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:26.927650 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-589a8c8e-6352-4eb1-88ee-adaa8cbb838c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:26.928826 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-589a8c8e-6352-4eb1-88ee-adaa8cbb838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:27.020874 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 666/1337] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:27.060423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6d6e5-5512-4863-9ab5-5494d4fcc44b None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:27.061932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-03f6d6e5-5512-4863-9ab5-5494d4fcc44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:27.162892 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6d6e5-5512-4863-9ab5-5494d4fcc44b None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:27.233425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38183e5f-ae83-4ed1-be26-49b7abe8fb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:27.234098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38183e5f-ae83-4ed1-be26-49b7abe8fb24 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:27.234405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38183e5f-ae83-4ed1-be26-49b7abe8fb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:27.234674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38183e5f-ae83-4ed1-be26-49b7abe8fb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:27.236285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-38183e5f-ae83-4ed1-be26-49b7abe8fb24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:27.349884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38183e5f-ae83-4ed1-be26-49b7abe8fb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:27.351476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38183e5f-ae83-4ed1-be26-49b7abe8fb24 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:27.370382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 672/1338] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:30.181234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875faee0-38ab-4f28-942c-f6303061c222 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:30.181741 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875faee0-38ab-4f28-942c-f6303061c222 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:30.181828 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875faee0-38ab-4f28-942c-f6303061c222 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:30.183598 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 667/1339] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:30.189142 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba022cc-c98c-4533-a04e-5f50e9e70b88 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:30.189542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba022cc-c98c-4533-a04e-5f50e9e70b88 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:30.189691 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba022cc-c98c-4533-a04e-5f50e9e70b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:30.260597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-8ba022cc-c98c-4533-a04e-5f50e9e70b88 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:30.261736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8ba022cc-c98c-4533-a04e-5f50e9e70b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:30.367293 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 673/1340] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:30.403925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875faee0-38ab-4f28-942c-f6303061c222 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:30.406026 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-875faee0-38ab-4f28-942c-f6303061c222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:30.504683 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875faee0-38ab-4f28-942c-f6303061c222 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:30.508347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6467d2-628c-45af-9267-67145ab23c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:30.508987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6467d2-628c-45af-9267-67145ab23c29 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:30.509274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6467d2-628c-45af-9267-67145ab23c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:30.509549 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6467d2-628c-45af-9267-67145ab23c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:30.518519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6467d2-628c-45af-9267-67145ab23c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:30.520457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6467d2-628c-45af-9267-67145ab23c29 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:30.529728 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 668/1341] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:34.989659 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98a5d3-42de-4d9a-9937-f8b349432d00 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:34.990197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98a5d3-42de-4d9a-9937-f8b349432d00 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:34.990305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98a5d3-42de-4d9a-9937-f8b349432d00 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:34.992384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 674/1342] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:34.997805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b95d6-a857-4386-a399-44ace06981db None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:34.998257 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b95d6-a857-4386-a399-44ace06981db None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:34.998399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b95d6-a857-4386-a399-44ace06981db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:35.027596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-812b95d6-a857-4386-a399-44ace06981db None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:35.028998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-812b95d6-a857-4386-a399-44ace06981db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:35.110406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 669/1343] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:30:35.145601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98a5d3-42de-4d9a-9937-f8b349432d00 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:35.156199 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98a5d3-42de-4d9a-9937-f8b349432d00 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:35.160418 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e65a35-d6d3-4dfc-a95a-5741de3f0694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:35.161100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e65a35-d6d3-4dfc-a95a-5741de3f0694 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:35.161381 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e65a35-d6d3-4dfc-a95a-5741de3f0694 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:35.161651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e65a35-d6d3-4dfc-a95a-5741de3f0694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:35.170508 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e65a35-d6d3-4dfc-a95a-5741de3f0694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:35.171941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e65a35-d6d3-4dfc-a95a-5741de3f0694 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:35.181231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 675/1344] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:38.110001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243d79-d85b-4085-b9f2-756c151804e2 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:38.110453 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243d79-d85b-4085-b9f2-756c151804e2 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:38.110543 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243d79-d85b-4085-b9f2-756c151804e2 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:38.112337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 670/1345] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:38.118078 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58ac6-3b2a-416c-9a5a-8687c9cb06ac None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:38.118566 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58ac6-3b2a-416c-9a5a-8687c9cb06ac None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:38.118958 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58ac6-3b2a-416c-9a5a-8687c9cb06ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:38.137367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-ace58ac6-3b2a-416c-9a5a-8687c9cb06ac None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:38.138660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ace58ac6-3b2a-416c-9a5a-8687c9cb06ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:38.147297 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 676/1346] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:38.184684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243d79-d85b-4085-b9f2-756c151804e2 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:38.195187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243d79-d85b-4085-b9f2-756c151804e2 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:38.198833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef43b2a-a1a8-4e59-8108-60ce5aa71f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:38.199555 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef43b2a-a1a8-4e59-8108-60ce5aa71f76 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:38.199935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef43b2a-a1a8-4e59-8108-60ce5aa71f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:38.200275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef43b2a-a1a8-4e59-8108-60ce5aa71f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:38.209490 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef43b2a-a1a8-4e59-8108-60ce5aa71f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:38.210932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef43b2a-a1a8-4e59-8108-60ce5aa71f76 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:38.220175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 671/1347] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:42.663197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3717c3-7ed6-4f36-aba5-801e0f940bb3 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:42.663768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3717c3-7ed6-4f36-aba5-801e0f940bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:42.663768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3717c3-7ed6-4f36-aba5-801e0f940bb3 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:42.665602 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 677/1348] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:42.670812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d7db0-8059-4803-9694-0d7cf7c68ea1 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:42.671221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d7db0-8059-4803-9694-0d7cf7c68ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:42.671388 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d7db0-8059-4803-9694-0d7cf7c68ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:42.689251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-507d7db0-8059-4803-9694-0d7cf7c68ea1 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:42.691046 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-507d7db0-8059-4803-9694-0d7cf7c68ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:42.698715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 672/1349] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:42.737349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3717c3-7ed6-4f36-aba5-801e0f940bb3 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:42.748105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3717c3-7ed6-4f36-aba5-801e0f940bb3 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:42.751634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c24a5-1f25-4e6e-94d1-673fcf9027ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:42.752263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c24a5-1f25-4e6e-94d1-673fcf9027ef service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:42.752545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c24a5-1f25-4e6e-94d1-673fcf9027ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:42.752822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c24a5-1f25-4e6e-94d1-673fcf9027ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:42.762292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c24a5-1f25-4e6e-94d1-673fcf9027ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:42.763727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c24a5-1f25-4e6e-94d1-673fcf9027ef service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:42.773564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 678/1350] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:47.997636 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120564ef-fe19-425d-8c42-fff4315c081f None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:47.998497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120564ef-fe19-425d-8c42-fff4315c081f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:47.999788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120564ef-fe19-425d-8c42-fff4315c081f None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:48.001971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 673/1351] 10.222.0.79 () {54 vars in 921 bytes} [Mon Feb 21 01:30:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:48.007468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c58ae-0a90-41e9-abc5-cda33b0c8dad None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:48.007908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c58ae-0a90-41e9-abc5-cda33b0c8dad None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:48.008010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c58ae-0a90-41e9-abc5-cda33b0c8dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:48.119627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-9d4c58ae-0a90-41e9-abc5-cda33b0c8dad None None] MFA Rules not processed for user `02e7385005924d4f8c220c986b9866de`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:48.121335 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9d4c58ae-0a90-41e9-abc5-cda33b0c8dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:48.201595 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 679/1352] 10.222.0.79 () {58 vars in 1018 bytes} [Mon Feb 21 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:52.482349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbbbc2-2703-4c51-9e3c-f1ec81f9674d None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:52.482855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbbbc2-2703-4c51-9e3c-f1ec81f9674d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:52.482934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbbbc2-2703-4c51-9e3c-f1ec81f9674d None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:52.484831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 674/1353] 10.222.0.79 () {54 vars in 921 bytes} [Mon Feb 21 01:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:52.490499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9a610-bc89-4d41-89b6-bba3660d28df None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:52.491369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9a610-bc89-4d41-89b6-bba3660d28df None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:52.491854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9a610-bc89-4d41-89b6-bba3660d28df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:52.511553 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-f3b9a610-bc89-4d41-89b6-bba3660d28df None None] MFA Rules not processed for user `02e7385005924d4f8c220c986b9866de`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:52.513098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f3b9a610-bc89-4d41-89b6-bba3660d28df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:52.522030 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 680/1354] 10.222.0.79 () {58 vars in 1018 bytes} [Mon Feb 21 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:30:54.009109 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc016-396d-47d6-b97c-470eb6f51d10 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:54.009776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc016-396d-47d6-b97c-470eb6f51d10 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:54.010174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc016-396d-47d6-b97c-470eb6f51d10 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:54.012436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 675/1355] 10.222.0.79 () {54 vars in 921 bytes} [Mon Feb 21 01:30:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:54.103394 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f17b3f-bd58-4648-b154-3f6aa944f0bf None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:54.103927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f17b3f-bd58-4648-b154-3f6aa944f0bf None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:54.104123 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f17b3f-bd58-4648-b154-3f6aa944f0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:54.122828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a7f17b3f-bd58-4648-b154-3f6aa944f0bf None None] MFA Rules not processed for user `02e7385005924d4f8c220c986b9866de`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:54.129155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a7f17b3f-bd58-4648-b154-3f6aa944f0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:54.137947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 681/1356] 10.222.0.79 () {58 vars in 1018 bytes} [Mon Feb 21 01:30:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:57.915066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508a5cd-d14b-4272-9208-10b1fe75a461 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:57.915583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508a5cd-d14b-4272-9208-10b1fe75a461 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:57.915967 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508a5cd-d14b-4272-9208-10b1fe75a461 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:57.917973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 676/1357] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:57.923028 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150e4bd-df74-4941-a428-4b786c33ba08 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:57.923428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150e4bd-df74-4941-a428-4b786c33ba08 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:57.923576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150e4bd-df74-4941-a428-4b786c33ba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:57.942288 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c150e4bd-df74-4941-a428-4b786c33ba08 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:57.943462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c150e4bd-df74-4941-a428-4b786c33ba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:57.951679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 682/1358] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:58.001587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a656213-f1ac-4de0-afef-d79630843470 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:58.003409 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a656213-f1ac-4de0-afef-d79630843470 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:58.003691 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a656213-f1ac-4de0-afef-d79630843470 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:58.005623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 677/1359] 10.222.0.79 () {54 vars in 961 bytes} [Mon Feb 21 01:30:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:58.028503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bb1c3-5242-4070-9d21-359db55d45f4 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:58.029275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bb1c3-5242-4070-9d21-359db55d45f4 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:58.029770 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bb1c3-5242-4070-9d21-359db55d45f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:58.079417 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-969bb1c3-5242-4070-9d21-359db55d45f4 None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:58.080606 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-969bb1c3-5242-4070-9d21-359db55d45f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:58.167675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 683/1360] 10.222.0.79 () {58 vars in 1058 bytes} [Mon Feb 21 01:30:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:58.175940 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a656213-f1ac-4de0-afef-d79630843470 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:58.190758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a656213-f1ac-4de0-afef-d79630843470 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:58.196546 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a5139-455f-4649-aa7f-c620adddca59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:58.197280 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5139-455f-4649-aa7f-c620adddca59 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:58.197632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5139-455f-4649-aa7f-c620adddca59 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:58.197977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5139-455f-4649-aa7f-c620adddca59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:58.206917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a5139-455f-4649-aa7f-c620adddca59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:58.208572 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a5139-455f-4649-aa7f-c620adddca59 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:58.220070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 678/1361] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:00.755881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd157b-51e0-4795-8a08-c2f7b51adb0a None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:00.756429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd157b-51e0-4795-8a08-c2f7b51adb0a None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:00.756882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd157b-51e0-4795-8a08-c2f7b51adb0a None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:00.758860 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 684/1362] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:00.764138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1da45-863b-4084-9075-b8b289048b4c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:00.764557 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1da45-863b-4084-9075-b8b289048b4c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:00.764719 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1da45-863b-4084-9075-b8b289048b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:00.783738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-60d1da45-863b-4084-9075-b8b289048b4c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:00.784995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-60d1da45-863b-4084-9075-b8b289048b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:00.794580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 679/1363] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:00.837330 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd157b-51e0-4795-8a08-c2f7b51adb0a None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:00.852678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd157b-51e0-4795-8a08-c2f7b51adb0a None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:00.858408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490caf84-9389-498c-a898-8e1e8dd9acb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:00.859141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490caf84-9389-498c-a898-8e1e8dd9acb1 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:00.859523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490caf84-9389-498c-a898-8e1e8dd9acb1 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:00.859917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490caf84-9389-498c-a898-8e1e8dd9acb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:00.868738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490caf84-9389-498c-a898-8e1e8dd9acb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:00.870711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490caf84-9389-498c-a898-8e1e8dd9acb1 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:00.881037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 685/1364] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:03.476249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0eef-f2e8-4817-bc30-b1f3980e5512 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:03.477201 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0eef-f2e8-4817-bc30-b1f3980e5512 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:03.477492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0eef-f2e8-4817-bc30-b1f3980e5512 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:03.479370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 680/1365] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:03.484688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308da243-d34f-4566-a16c-848e79c86ef9 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:03.485103 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308da243-d34f-4566-a16c-848e79c86ef9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:03.485238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308da243-d34f-4566-a16c-848e79c86ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:03.503627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-308da243-d34f-4566-a16c-848e79c86ef9 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:03.504784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-308da243-d34f-4566-a16c-848e79c86ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:03.513463 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 686/1366] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:03.558929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3bba0-4f7d-4c10-87f9-d9f4361fa549 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:03.559336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3bba0-4f7d-4c10-87f9-d9f4361fa549 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:03.559651 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3bba0-4f7d-4c10-87f9-d9f4361fa549 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:03.561399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 681/1367] 10.222.0.79 () {54 vars in 961 bytes} [Mon Feb 21 01:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:03.567368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34822308-c158-48cf-8cfc-625c236fbd28 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:03.567666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34822308-c158-48cf-8cfc-625c236fbd28 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:03.567956 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34822308-c158-48cf-8cfc-625c236fbd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:03.586620 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-34822308-c158-48cf-8cfc-625c236fbd28 None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:03.587890 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-34822308-c158-48cf-8cfc-625c236fbd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:03.599944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 687/1368] 10.222.0.79 () {58 vars in 1058 bytes} [Mon Feb 21 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:31:03.609210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3bba0-4f7d-4c10-87f9-d9f4361fa549 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:03.627450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3bba0-4f7d-4c10-87f9-d9f4361fa549 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:03.636162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078d784-d656-400f-96ab-c3ec64b4c3a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:03.636833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078d784-d656-400f-96ab-c3ec64b4c3a2 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:03.638439 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078d784-d656-400f-96ab-c3ec64b4c3a2 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:03.638439 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078d784-d656-400f-96ab-c3ec64b4c3a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:03.653327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078d784-d656-400f-96ab-c3ec64b4c3a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:03.654986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078d784-d656-400f-96ab-c3ec64b4c3a2 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:03.665959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 682/1369] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:06.055099 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e503c1-4604-4e37-8aaf-715955f6e2ce None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:06.055622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e503c1-4604-4e37-8aaf-715955f6e2ce None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:06.055622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e503c1-4604-4e37-8aaf-715955f6e2ce None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:06.057532 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 688/1370] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:06.063070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0f587-9637-4bbc-8a3a-10e4b35e9406 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:06.063508 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0f587-9637-4bbc-8a3a-10e4b35e9406 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:06.063668 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0f587-9637-4bbc-8a3a-10e4b35e9406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:06.082114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-21b0f587-9637-4bbc-8a3a-10e4b35e9406 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:06.083309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-21b0f587-9637-4bbc-8a3a-10e4b35e9406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:06.095684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 683/1371] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:06.116631 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a6b27-3b12-4373-9b43-e80011c86c63 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:06.116914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a6b27-3b12-4373-9b43-e80011c86c63 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:06.117367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a6b27-3b12-4373-9b43-e80011c86c63 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:06.119185 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 689/1372] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:06.124825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890da62-8e48-4acf-bb49-75d2658133d3 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:06.125383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890da62-8e48-4acf-bb49-75d2658133d3 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:06.125672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890da62-8e48-4acf-bb49-75d2658133d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:06.142489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a6b27-3b12-4373-9b43-e80011c86c63 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:06.145176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-1890da62-8e48-4acf-bb49-75d2658133d3 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:06.146406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-1890da62-8e48-4acf-bb49-75d2658133d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:06.154422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 684/1373] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:06.157418 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a6b27-3b12-4373-9b43-e80011c86c63 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:06.162912 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e0c93-494a-4c8f-ac12-f7de56416dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:06.163539 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e0c93-494a-4c8f-ac12-f7de56416dba service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:06.163894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e0c93-494a-4c8f-ac12-f7de56416dba service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:06.164167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e0c93-494a-4c8f-ac12-f7de56416dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:06.172548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e0c93-494a-4c8f-ac12-f7de56416dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:06.174858 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e0c93-494a-4c8f-ac12-f7de56416dba service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:06.184551 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 690/1374] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:31:06.413816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29089d35-384f-4079-b362-21227d181fcc None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:06.413996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29089d35-384f-4079-b362-21227d181fcc None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:06.414298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29089d35-384f-4079-b362-21227d181fcc None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:06.416469 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 685/1375] 10.222.0.79 () {54 vars in 963 bytes} [Mon Feb 21 01:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:06.427415 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c3fb5-5b39-46df-8fed-400cb1c3ff61 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:06.427701 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c3fb5-5b39-46df-8fed-400cb1c3ff61 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:06.428137 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c3fb5-5b39-46df-8fed-400cb1c3ff61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:06.476935 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a36c3fb5-5b39-46df-8fed-400cb1c3ff61 None None] MFA Rules not processed for user `48ca95750bea45019bdc0b34b8f445df`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:06.478390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a36c3fb5-5b39-46df-8fed-400cb1c3ff61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:06.540720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 691/1376] 10.222.0.79 () {58 vars in 1060 bytes} [Mon Feb 21 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:06.547127 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29089d35-384f-4079-b362-21227d181fcc None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:06.558621 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29089d35-384f-4079-b362-21227d181fcc None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:06.562235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a1986-08a6-4f80-a0d5-88a57a004ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:06.562959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a1986-08a6-4f80-a0d5-88a57a004ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:06.563314 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a1986-08a6-4f80-a0d5-88a57a004ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:06.563658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a1986-08a6-4f80-a0d5-88a57a004ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:06.573074 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a1986-08a6-4f80-a0d5-88a57a004ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:06.574650 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a1986-08a6-4f80-a0d5-88a57a004ce6 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:06.584805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 686/1377] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:31:08.547574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5fcf5-e7cd-4c70-9aaa-1d7c576acf0f None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:08.547974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5fcf5-e7cd-4c70-9aaa-1d7c576acf0f None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:08.548121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5fcf5-e7cd-4c70-9aaa-1d7c576acf0f None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:08.550293 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 692/1378] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:08.555798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a673-f465-459b-9906-b83ddc13faa9 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:08.556236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a673-f465-459b-9906-b83ddc13faa9 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:08.556361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a673-f465-459b-9906-b83ddc13faa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:08.574958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-3496a673-f465-459b-9906-b83ddc13faa9 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:08.576146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3496a673-f465-459b-9906-b83ddc13faa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:08.584710 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 687/1379] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:08.629413 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5fcf5-e7cd-4c70-9aaa-1d7c576acf0f None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:08.645131 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5fcf5-e7cd-4c70-9aaa-1d7c576acf0f None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:08.650507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff121a9-75ab-4826-9227-8d86c392eef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:08.651165 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff121a9-75ab-4826-9227-8d86c392eef7 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:08.651445 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff121a9-75ab-4826-9227-8d86c392eef7 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:08.651720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff121a9-75ab-4826-9227-8d86c392eef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:08.659758 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff121a9-75ab-4826-9227-8d86c392eef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:08.662560 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff121a9-75ab-4826-9227-8d86c392eef7 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:08.682491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 693/1380] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:11.034865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec31dc-4ff6-4e77-8187-f9e7896cfc09 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:11.035500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec31dc-4ff6-4e77-8187-f9e7896cfc09 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:11.035724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec31dc-4ff6-4e77-8187-f9e7896cfc09 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:11.037623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 688/1381] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:11.042956 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4114f2f-d83d-4061-8f02-15e348284975 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:11.043380 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4114f2f-d83d-4061-8f02-15e348284975 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:11.043527 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4114f2f-d83d-4061-8f02-15e348284975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:11.061170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-f4114f2f-d83d-4061-8f02-15e348284975 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:11.062368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f4114f2f-d83d-4061-8f02-15e348284975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:11.070896 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 694/1382] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:11.114518 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec31dc-4ff6-4e77-8187-f9e7896cfc09 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:11.130076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec31dc-4ff6-4e77-8187-f9e7896cfc09 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:11.135828 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed1bd8-6b22-4693-b282-752f2056e8cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:11.136764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed1bd8-6b22-4693-b282-752f2056e8cf service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:11.137142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed1bd8-6b22-4693-b282-752f2056e8cf service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:11.137592 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed1bd8-6b22-4693-b282-752f2056e8cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:11.145770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed1bd8-6b22-4693-b282-752f2056e8cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:11.147847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed1bd8-6b22-4693-b282-752f2056e8cf service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:11.158004 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 689/1383] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:13.512588 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104afd0-9a8b-4e52-82f3-2029b83f9271 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:13.513156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104afd0-9a8b-4e52-82f3-2029b83f9271 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:13.513156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104afd0-9a8b-4e52-82f3-2029b83f9271 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:13.514961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 695/1384] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:13.520687 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c6d4-f5f0-4aeb-8159-acb8ab6dd688 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:13.521086 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c6d4-f5f0-4aeb-8159-acb8ab6dd688 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:13.521275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c6d4-f5f0-4aeb-8159-acb8ab6dd688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:13.539925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f4e3c6d4-f5f0-4aeb-8159-acb8ab6dd688 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:13.541115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f4e3c6d4-f5f0-4aeb-8159-acb8ab6dd688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:13.549030 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 690/1385] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:13.590188 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104afd0-9a8b-4e52-82f3-2029b83f9271 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:13.606031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104afd0-9a8b-4e52-82f3-2029b83f9271 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:13.612006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8a0de-2d12-4ba3-98b8-a9b6c4f2af87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:13.612799 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8a0de-2d12-4ba3-98b8-a9b6c4f2af87 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:13.613270 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8a0de-2d12-4ba3-98b8-a9b6c4f2af87 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:13.613643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8a0de-2d12-4ba3-98b8-a9b6c4f2af87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:13.622893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8a0de-2d12-4ba3-98b8-a9b6c4f2af87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:13.624671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8a0de-2d12-4ba3-98b8-a9b6c4f2af87 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:13.635327 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 696/1386] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:16.063929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e01753-b6ab-49e2-870d-58ade4eabe63 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:16.064601 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e01753-b6ab-49e2-870d-58ade4eabe63 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:16.064601 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e01753-b6ab-49e2-870d-58ade4eabe63 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:16.066529 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 691/1387] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:16.071645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f10a0b-9717-41c5-9884-f9e3f616732f None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:16.072189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f10a0b-9717-41c5-9884-f9e3f616732f None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:16.072189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f10a0b-9717-41c5-9884-f9e3f616732f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:16.089908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-f8f10a0b-9717-41c5-9884-f9e3f616732f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:16.091225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f8f10a0b-9717-41c5-9884-f9e3f616732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:16.100231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 697/1388] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:16.144323 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e01753-b6ab-49e2-870d-58ade4eabe63 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:16.159323 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e01753-b6ab-49e2-870d-58ade4eabe63 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:16.164866 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c0ad5-548e-492c-b8a0-a17ed8bca448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:16.165504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c0ad5-548e-492c-b8a0-a17ed8bca448 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:16.165784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c0ad5-548e-492c-b8a0-a17ed8bca448 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:16.166056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c0ad5-548e-492c-b8a0-a17ed8bca448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:16.174915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c0ad5-548e-492c-b8a0-a17ed8bca448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:16.176495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c0ad5-548e-492c-b8a0-a17ed8bca448 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:16.185918 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 692/1389] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:18.542573 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ae8b0-64ea-4cc5-b38d-ceca9254f752 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:18.543122 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ae8b0-64ea-4cc5-b38d-ceca9254f752 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:18.543225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ae8b0-64ea-4cc5-b38d-ceca9254f752 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:18.544959 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 698/1390] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:18.550798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a78db-e17e-44eb-93f6-e866faf55754 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:18.551376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a78db-e17e-44eb-93f6-e866faf55754 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:18.551376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a78db-e17e-44eb-93f6-e866faf55754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:18.569726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f18a78db-e17e-44eb-93f6-e866faf55754 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:18.570954 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f18a78db-e17e-44eb-93f6-e866faf55754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:18.578879 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 693/1391] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:18.624676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ae8b0-64ea-4cc5-b38d-ceca9254f752 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:18.639324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ae8b0-64ea-4cc5-b38d-ceca9254f752 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:18.645284 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b5ce0-3e69-4941-91b3-5dc365f682da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:18.645916 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b5ce0-3e69-4941-91b3-5dc365f682da service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:18.646197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b5ce0-3e69-4941-91b3-5dc365f682da service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:18.646500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b5ce0-3e69-4941-91b3-5dc365f682da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:18.654496 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b5ce0-3e69-4941-91b3-5dc365f682da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:18.656076 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b5ce0-3e69-4941-91b3-5dc365f682da service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:18.666409 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 699/1392] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:21.136165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcad8d-2757-4757-be96-c7a60759df8e None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:21.136725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcad8d-2757-4757-be96-c7a60759df8e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:21.136725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcad8d-2757-4757-be96-c7a60759df8e None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:21.138495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 694/1393] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:21.143640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73996ff3-0d36-450a-867f-08251f0a2835 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:21.144052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73996ff3-0d36-450a-867f-08251f0a2835 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:21.144194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73996ff3-0d36-450a-867f-08251f0a2835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:21.161808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-73996ff3-0d36-450a-867f-08251f0a2835 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:21.163023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-73996ff3-0d36-450a-867f-08251f0a2835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:21.170836 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 700/1394] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:21.214421 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcad8d-2757-4757-be96-c7a60759df8e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:21.228728 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcad8d-2757-4757-be96-c7a60759df8e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:21.233976 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90857a4d-0755-4b5d-89d6-bfd7a3db6dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:21.234649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90857a4d-0755-4b5d-89d6-bfd7a3db6dfc service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:21.234933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90857a4d-0755-4b5d-89d6-bfd7a3db6dfc service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:21.235203 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90857a4d-0755-4b5d-89d6-bfd7a3db6dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:21.243775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90857a4d-0755-4b5d-89d6-bfd7a3db6dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:21.245615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90857a4d-0755-4b5d-89d6-bfd7a3db6dfc service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:21.255586 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 695/1395] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:21.793655 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b172cee-bb61-4427-a4b6-b308a61cb9e8 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:21.793940 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b172cee-bb61-4427-a4b6-b308a61cb9e8 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:21.794332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b172cee-bb61-4427-a4b6-b308a61cb9e8 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:21.796163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 701/1396] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:21.801356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee97196-a09c-45e0-ae54-76763a856bd1 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:21.801643 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee97196-a09c-45e0-ae54-76763a856bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:21.801921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee97196-a09c-45e0-ae54-76763a856bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:21.819529 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2ee97196-a09c-45e0-ae54-76763a856bd1 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:21.820697 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2ee97196-a09c-45e0-ae54-76763a856bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:21.828704 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 696/1397] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:21.884401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637b536-d4c1-4cee-adc9-1de0a3cd139b None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:21.884692 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637b536-d4c1-4cee-adc9-1de0a3cd139b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:21.884970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637b536-d4c1-4cee-adc9-1de0a3cd139b None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:21.886852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 702/1398] 10.222.0.79 () {54 vars in 962 bytes} [Mon Feb 21 01:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:21.892550 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06491c93-0670-435c-8efe-66c77f390ade None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:21.892836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06491c93-0670-435c-8efe-66c77f390ade None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:21.893112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06491c93-0670-435c-8efe-66c77f390ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:21.940025 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-06491c93-0670-435c-8efe-66c77f390ade None None] MFA Rules not processed for user `e68b3bc64dc94865a72cea0988fa9c65`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:21.941193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-06491c93-0670-435c-8efe-66c77f390ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:21.998613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 697/1399] 10.222.0.79 () {58 vars in 1059 bytes} [Mon Feb 21 01:31:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:31:22.006578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637b536-d4c1-4cee-adc9-1de0a3cd139b None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:22.017428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637b536-d4c1-4cee-adc9-1de0a3cd139b None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:22.020923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d276a30-d069-4b92-8345-413e5d4a3555 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68b3bc64dc94865a72cea0988fa9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:22.021545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d276a30-d069-4b92-8345-413e5d4a3555 service glance] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:22.021821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d276a30-d069-4b92-8345-413e5d4a3555 service glance] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:22.022090 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d276a30-d069-4b92-8345-413e5d4a3555 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:22.030766 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d276a30-d069-4b92-8345-413e5d4a3555 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:22.032213 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d276a30-d069-4b92-8345-413e5d4a3555 service glance] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:22.041825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 703/1400] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:22.450578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576f6d5-213a-4be8-898f-ddf6ce8a8fa8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:22.451066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576f6d5-213a-4be8-898f-ddf6ce8a8fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:22.451168 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576f6d5-213a-4be8-898f-ddf6ce8a8fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:22.498987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-c576f6d5-213a-4be8-898f-ddf6ce8a8fa8 None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:22.500196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c576f6d5-213a-4be8-898f-ddf6ce8a8fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:22.561222 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 698/1401] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:22.601982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38367f8e-b82f-4aed-b989-9deee1a6501c None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:22.602601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38367f8e-b82f-4aed-b989-9deee1a6501c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:22.603157 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38367f8e-b82f-4aed-b989-9deee1a6501c None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:22.605229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 704/1402] 10.222.0.79 () {54 vars in 942 bytes} [Mon Feb 21 01:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:22.612167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102fb39-65ae-4066-9830-6b9b71b48a25 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:22.612455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102fb39-65ae-4066-9830-6b9b71b48a25 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:22.612738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102fb39-65ae-4066-9830-6b9b71b48a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:22.659933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0102fb39-65ae-4066-9830-6b9b71b48a25 None None] MFA Rules not processed for user `0cb0a0d56f0049b19ba22e0dd041897e`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:22.661045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0102fb39-65ae-4066-9830-6b9b71b48a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:22.731214 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 699/1403] 10.222.0.79 () {58 vars in 1039 bytes} [Mon Feb 21 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:22.740819 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38367f8e-b82f-4aed-b989-9deee1a6501c None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:22.754016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38367f8e-b82f-4aed-b989-9deee1a6501c None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:22.758996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e78616-2047-43e4-bd28-e0a7c480d476 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:22.759619 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e78616-2047-43e4-bd28-e0a7c480d476 service swift] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:22.759895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e78616-2047-43e4-bd28-e0a7c480d476 service swift] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:22.760162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e78616-2047-43e4-bd28-e0a7c480d476 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:22.768119 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e78616-2047-43e4-bd28-e0a7c480d476 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:22.769676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e78616-2047-43e4-bd28-e0a7c480d476 service swift] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:22.777280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 705/1404] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:31:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:31:23.578483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fabee5-01ff-439d-9542-982dfaebb4c9 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:23.579581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fabee5-01ff-439d-9542-982dfaebb4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:23.579693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fabee5-01ff-439d-9542-982dfaebb4c9 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:23.585149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 700/1405] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:23.586641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f67d58-5201-4b2b-85d9-6447cde35a63 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:23.586933 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f67d58-5201-4b2b-85d9-6447cde35a63 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:23.587385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f67d58-5201-4b2b-85d9-6447cde35a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:23.608325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-94f67d58-5201-4b2b-85d9-6447cde35a63 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:23.609528 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-94f67d58-5201-4b2b-85d9-6447cde35a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:23.618147 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 706/1406] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:31:23.662584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fabee5-01ff-439d-9542-982dfaebb4c9 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:23.679893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fabee5-01ff-439d-9542-982dfaebb4c9 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:23.685649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e05f1-636b-4257-9fe2-4c656cc62990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:23.686456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e05f1-636b-4257-9fe2-4c656cc62990 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:23.687014 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e05f1-636b-4257-9fe2-4c656cc62990 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:23.687391 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e05f1-636b-4257-9fe2-4c656cc62990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:23.696880 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e05f1-636b-4257-9fe2-4c656cc62990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:23.698657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e05f1-636b-4257-9fe2-4c656cc62990 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:23.709160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 701/1407] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:26.121061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a90a5-4621-4704-9b85-7079abbcdfe9 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:26.121609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a90a5-4621-4704-9b85-7079abbcdfe9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:26.121609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a90a5-4621-4704-9b85-7079abbcdfe9 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:26.123550 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 707/1408] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:26.128570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd07c-f50a-435f-89f7-54388e8bc314 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:26.128968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd07c-f50a-435f-89f7-54388e8bc314 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:26.129117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd07c-f50a-435f-89f7-54388e8bc314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:26.147516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-9d1dd07c-f50a-435f-89f7-54388e8bc314 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:26.148725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9d1dd07c-f50a-435f-89f7-54388e8bc314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:26.157717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 702/1409] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:26.202366 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a90a5-4621-4704-9b85-7079abbcdfe9 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:26.217148 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a90a5-4621-4704-9b85-7079abbcdfe9 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:26.223191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a501cc0-86cb-438d-a6b2-9c40a1ddc47a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:26.223960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a501cc0-86cb-438d-a6b2-9c40a1ddc47a service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:26.224249 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a501cc0-86cb-438d-a6b2-9c40a1ddc47a service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:26.224534 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a501cc0-86cb-438d-a6b2-9c40a1ddc47a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:26.232966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a501cc0-86cb-438d-a6b2-9c40a1ddc47a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:26.234632 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a501cc0-86cb-438d-a6b2-9c40a1ddc47a service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:26.243857 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 708/1410] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:45.750981 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5f8b-3b5d-4133-a4e8-35d113abb910 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:45.751625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5f8b-3b5d-4133-a4e8-35d113abb910 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:45.751625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5f8b-3b5d-4133-a4e8-35d113abb910 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:45.753302 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 703/1411] 10.222.0.79 () {54 vars in 918 bytes} [Mon Feb 21 01:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:45.758806 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f1d52-255c-4650-ad5b-4c163df385c4 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:45.759297 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f1d52-255c-4650-ad5b-4c163df385c4 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:45.759403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f1d52-255c-4650-ad5b-4c163df385c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:45.776739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-cf9f1d52-255c-4650-ad5b-4c163df385c4 None None] MFA Rules not processed for user `02e7385005924d4f8c220c986b9866de`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:45.777899 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-cf9f1d52-255c-4650-ad5b-4c163df385c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:45.786105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 709/1412] 10.222.0.79 () {58 vars in 1015 bytes} [Mon Feb 21 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:45.801654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58479-4e67-4b12-ba86-94bab9fdbf5b None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:45.801944 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58479-4e67-4b12-ba86-94bab9fdbf5b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:45.802259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58479-4e67-4b12-ba86-94bab9fdbf5b None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:45.804089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 704/1413] 10.222.0.79 () {54 vars in 918 bytes} [Mon Feb 21 01:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:45.808564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6df2b-8a1b-4f51-97cc-af74da9e0671 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:45.808852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6df2b-8a1b-4f51-97cc-af74da9e0671 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:45.809123 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6df2b-8a1b-4f51-97cc-af74da9e0671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:45.827052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a6a6df2b-8a1b-4f51-97cc-af74da9e0671 None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:45.828272 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a6a6df2b-8a1b-4f51-97cc-af74da9e0671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:45.837926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 710/1414] 10.222.0.79 () {58 vars in 1015 bytes} [Mon Feb 21 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:48.573539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef349441-5944-441b-a66e-d9c0610c05b0 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:48.574059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef349441-5944-441b-a66e-d9c0610c05b0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:48.574298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef349441-5944-441b-a66e-d9c0610c05b0 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:48.575879 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 705/1415] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:48.581765 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d525b0-413a-4e69-97a8-b4d811ba8995 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:48.582193 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d525b0-413a-4e69-97a8-b4d811ba8995 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:48.582321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d525b0-413a-4e69-97a8-b4d811ba8995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:48.600886 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a2d525b0-413a-4e69-97a8-b4d811ba8995 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:48.602059 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a2d525b0-413a-4e69-97a8-b4d811ba8995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:48.610977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 711/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:48.651995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef349441-5944-441b-a66e-d9c0610c05b0 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:48.666693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef349441-5944-441b-a66e-d9c0610c05b0 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:48.672050 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8435bf-21fe-4d16-a48a-a29ece645604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:48.672678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8435bf-21fe-4d16-a48a-a29ece645604 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:48.672961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8435bf-21fe-4d16-a48a-a29ece645604 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:48.673236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8435bf-21fe-4d16-a48a-a29ece645604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:48.681137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8435bf-21fe-4d16-a48a-a29ece645604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:48.682742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8435bf-21fe-4d16-a48a-a29ece645604 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:48.691890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 706/1417] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:50.063589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f85b3-6d07-4970-99ef-998d5ead2efd None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:50.064177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f85b3-6d07-4970-99ef-998d5ead2efd None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:50.064177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f85b3-6d07-4970-99ef-998d5ead2efd None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:50.065950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 712/1418] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:50.070928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf380bf-3cd2-43ce-a356-90a6e4d76356 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:50.071326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf380bf-3cd2-43ce-a356-90a6e4d76356 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:50.071478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf380bf-3cd2-43ce-a356-90a6e4d76356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:50.089348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-adf380bf-3cd2-43ce-a356-90a6e4d76356 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:50.090617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-adf380bf-3cd2-43ce-a356-90a6e4d76356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:50.101178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 707/1419] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:50.269689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f85b3-6d07-4970-99ef-998d5ead2efd None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:50.284222 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f85b3-6d07-4970-99ef-998d5ead2efd None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:50.289483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa989d-6cfa-4720-8e66-8cbb27601c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:50.290111 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa989d-6cfa-4720-8e66-8cbb27601c82 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:50.290426 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa989d-6cfa-4720-8e66-8cbb27601c82 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:50.290705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa989d-6cfa-4720-8e66-8cbb27601c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:50.298549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa989d-6cfa-4720-8e66-8cbb27601c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:50.300128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa989d-6cfa-4720-8e66-8cbb27601c82 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:50.309470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 713/1420] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:31:51.654428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa9779-6cc7-4e64-bbd4-0dc06a22f12d None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:51.655007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa9779-6cc7-4e64-bbd4-0dc06a22f12d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:51.655007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa9779-6cc7-4e64-bbd4-0dc06a22f12d None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:51.656724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 708/1421] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:51.661735 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07f2cf-ad3e-42be-a257-af84cc2205fa None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:51.662141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07f2cf-ad3e-42be-a257-af84cc2205fa None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:51.662322 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07f2cf-ad3e-42be-a257-af84cc2205fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:51.680450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-4a07f2cf-ad3e-42be-a257-af84cc2205fa None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:51.681623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-4a07f2cf-ad3e-42be-a257-af84cc2205fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:51.689982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 714/1422] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:51.839137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa9779-6cc7-4e64-bbd4-0dc06a22f12d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:51.854088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa9779-6cc7-4e64-bbd4-0dc06a22f12d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:51.859857 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8e38-bf34-41bf-90e6-a7a09ead10ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:51.860489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8e38-bf34-41bf-90e6-a7a09ead10ba service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:51.860768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8e38-bf34-41bf-90e6-a7a09ead10ba service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:51.861071 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8e38-bf34-41bf-90e6-a7a09ead10ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:51.868793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a8e38-bf34-41bf-90e6-a7a09ead10ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:51.870653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a8e38-bf34-41bf-90e6-a7a09ead10ba service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:51.880108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 709/1423] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:53.164638 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cac12-19ca-4ef8-8aad-7ad871fda00e None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:53.165189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cac12-19ca-4ef8-8aad-7ad871fda00e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:53.165189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cac12-19ca-4ef8-8aad-7ad871fda00e None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:53.167055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 715/1424] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:53.172548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882b073-fb5c-4ac9-901d-67da7db1b98c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:53.172947 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882b073-fb5c-4ac9-901d-67da7db1b98c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:53.173097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882b073-fb5c-4ac9-901d-67da7db1b98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:53.191118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0882b073-fb5c-4ac9-901d-67da7db1b98c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:53.192282 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0882b073-fb5c-4ac9-901d-67da7db1b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:53.199927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 710/1425] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:53.348121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cac12-19ca-4ef8-8aad-7ad871fda00e None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:53.362351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cac12-19ca-4ef8-8aad-7ad871fda00e None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:53.367616 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b9634-be19-4ca4-a729-d7cc4b868c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:53.368269 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b9634-be19-4ca4-a729-d7cc4b868c00 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:53.368550 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b9634-be19-4ca4-a729-d7cc4b868c00 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:53.368823 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b9634-be19-4ca4-a729-d7cc4b868c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:53.377509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b9634-be19-4ca4-a729-d7cc4b868c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:53.379126 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b9634-be19-4ca4-a729-d7cc4b868c00 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:53.388147 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 716/1426] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:54.702966 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05003af4-e3a0-44a7-89aa-d362e18e597a None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:54.703484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05003af4-e3a0-44a7-89aa-d362e18e597a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:54.703484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05003af4-e3a0-44a7-89aa-d362e18e597a None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:54.705255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 711/1427] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:54.710157 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142c46b-c255-4178-9fc6-fb1b6b4ac69b None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:54.710565 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142c46b-c255-4178-9fc6-fb1b6b4ac69b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:54.710725 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142c46b-c255-4178-9fc6-fb1b6b4ac69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:54.728320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c142c46b-c255-4178-9fc6-fb1b6b4ac69b None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:54.729480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c142c46b-c255-4178-9fc6-fb1b6b4ac69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:54.737729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 717/1428] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:54.889684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05003af4-e3a0-44a7-89aa-d362e18e597a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:54.903583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05003af4-e3a0-44a7-89aa-d362e18e597a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:54.908989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263af5c-7a19-49bc-8979-eb556d98bbcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:54.909615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263af5c-7a19-49bc-8979-eb556d98bbcb service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:54.909894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263af5c-7a19-49bc-8979-eb556d98bbcb service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:54.910173 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263af5c-7a19-49bc-8979-eb556d98bbcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:54.917894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263af5c-7a19-49bc-8979-eb556d98bbcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:54.919487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263af5c-7a19-49bc-8979-eb556d98bbcb service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:54.929072 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 712/1429] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:56.164506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e26b88-2f30-4726-a1fa-2ede04836446 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.165048 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e26b88-2f30-4726-a1fa-2ede04836446 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.165048 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e26b88-2f30-4726-a1fa-2ede04836446 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.166853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 718/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:56.171767 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76415f01-72ca-4720-a28c-fc2537665bd5 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.172184 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76415f01-72ca-4720-a28c-fc2537665bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.172341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76415f01-72ca-4720-a28c-fc2537665bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.190289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-76415f01-72ca-4720-a28c-fc2537665bd5 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.191459 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-76415f01-72ca-4720-a28c-fc2537665bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.199035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 713/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.347253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e26b88-2f30-4726-a1fa-2ede04836446 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.361134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e26b88-2f30-4726-a1fa-2ede04836446 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.366431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a908d5f-24c4-4aa7-9587-dfa634c0d2f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.367052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a908d5f-24c4-4aa7-9587-dfa634c0d2f6 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.367330 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a908d5f-24c4-4aa7-9587-dfa634c0d2f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.367608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a908d5f-24c4-4aa7-9587-dfa634c0d2f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.375724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a908d5f-24c4-4aa7-9587-dfa634c0d2f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.377281 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a908d5f-24c4-4aa7-9587-dfa634c0d2f6 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.386362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 719/1432] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:57.628579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6e1f6-c34d-4828-8f48-8f880a10143e None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.629073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6e1f6-c34d-4828-8f48-8f880a10143e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.629179 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6e1f6-c34d-4828-8f48-8f880a10143e None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.630957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 714/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:57.636002 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea200f0-9d9b-4de5-b739-5a75529e3e8a None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.636416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea200f0-9d9b-4de5-b739-5a75529e3e8a None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.636590 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea200f0-9d9b-4de5-b739-5a75529e3e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.655831 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-fea200f0-9d9b-4de5-b739-5a75529e3e8a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:57.657679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fea200f0-9d9b-4de5-b739-5a75529e3e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:57.665542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 720/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:57.815313 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6e1f6-c34d-4828-8f48-8f880a10143e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.829118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6e1f6-c34d-4828-8f48-8f880a10143e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.834429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9673e7-beeb-4591-a5c6-ce5789a9a3b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.835053 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9673e7-beeb-4591-a5c6-ce5789a9a3b4 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.835331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9673e7-beeb-4591-a5c6-ce5789a9a3b4 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.835602 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9673e7-beeb-4591-a5c6-ce5789a9a3b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.843356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9673e7-beeb-4591-a5c6-ce5789a9a3b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.844953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9673e7-beeb-4591-a5c6-ce5789a9a3b4 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.854001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 715/1435] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:59.097049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5395cd-9b85-4644-ad8f-5a9d7b129920 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.097431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5395cd-9b85-4644-ad8f-5a9d7b129920 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.097431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5395cd-9b85-4644-ad8f-5a9d7b129920 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.099228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 721/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:59.104289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3b02d-d423-4c14-9379-66d8163ade9d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.104712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3b02d-d423-4c14-9379-66d8163ade9d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.104829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3b02d-d423-4c14-9379-66d8163ade9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.122630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f4b3b02d-d423-4c14-9379-66d8163ade9d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:59.123800 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f4b3b02d-d423-4c14-9379-66d8163ade9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:59.131351 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 716/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:59.285444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5395cd-9b85-4644-ad8f-5a9d7b129920 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.299221 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5395cd-9b85-4644-ad8f-5a9d7b129920 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.304447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8ccd9-a274-46f7-8fb3-6e17bccd8172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:59.305066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8ccd9-a274-46f7-8fb3-6e17bccd8172 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.305345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8ccd9-a274-46f7-8fb3-6e17bccd8172 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.305617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8ccd9-a274-46f7-8fb3-6e17bccd8172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.313562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8ccd9-a274-46f7-8fb3-6e17bccd8172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:59.315194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8ccd9-a274-46f7-8fb3-6e17bccd8172 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:59.324380 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 722/1438] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:32:00.573320 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1b65-d087-4e51-98c8-701dc7ed9fe0 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:00.573922 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1b65-d087-4e51-98c8-701dc7ed9fe0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:00.573922 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1b65-d087-4e51-98c8-701dc7ed9fe0 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:00.575681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 717/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:00.581250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e343-9bf8-472c-936a-ef64c8ba5652 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:00.581699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e343-9bf8-472c-936a-ef64c8ba5652 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:00.581820 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e343-9bf8-472c-936a-ef64c8ba5652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:00.600092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-de38e343-9bf8-472c-936a-ef64c8ba5652 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:00.601248 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-de38e343-9bf8-472c-936a-ef64c8ba5652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:00.609950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 723/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:00.757710 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1b65-d087-4e51-98c8-701dc7ed9fe0 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:00.771820 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1b65-d087-4e51-98c8-701dc7ed9fe0 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:00.777073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ffb1-0caa-4773-b43f-f7f081c81252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:00.777696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ffb1-0caa-4773-b43f-f7f081c81252 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:00.777974 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ffb1-0caa-4773-b43f-f7f081c81252 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:00.778274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ffb1-0caa-4773-b43f-f7f081c81252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:00.786572 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0ffb1-0caa-4773-b43f-f7f081c81252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:00.788142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0ffb1-0caa-4773-b43f-f7f081c81252 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:00.797219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 718/1441] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:32:02.979608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c338-3768-427e-8aa4-c296b7335d73 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:02.980198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c338-3768-427e-8aa4-c296b7335d73 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:02.980198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c338-3768-427e-8aa4-c296b7335d73 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:02.981938 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 724/1442] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:02.987906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7ce7f-eb06-42b7-8151-5c225133b6e8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:02.988327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7ce7f-eb06-42b7-8151-5c225133b6e8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:02.988464 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7ce7f-eb06-42b7-8151-5c225133b6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:03.006702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-43e7ce7f-eb06-42b7-8151-5c225133b6e8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:03.007892 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-43e7ce7f-eb06-42b7-8151-5c225133b6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:03.015643 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 719/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:03.053263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98c338-3768-427e-8aa4-c296b7335d73 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:03.064477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98c338-3768-427e-8aa4-c296b7335d73 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:03.068047 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4dfd1-a467-4075-a777-65a0265e57d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:03.068701 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4dfd1-a467-4075-a777-65a0265e57d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:03.068983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4dfd1-a467-4075-a777-65a0265e57d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:03.069257 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4dfd1-a467-4075-a777-65a0265e57d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:03.077992 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4dfd1-a467-4075-a777-65a0265e57d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:03.079539 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4dfd1-a467-4075-a777-65a0265e57d5 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:03.088729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 725/1444] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:05.507764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7973fa0-e430-4d48-a182-daf834827136 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:05.508333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7973fa0-e430-4d48-a182-daf834827136 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:05.508333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7973fa0-e430-4d48-a182-daf834827136 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:05.510081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 720/1445] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:05.515932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced822f8-252d-47ad-85fd-c60e7ba21f81 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:05.516367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced822f8-252d-47ad-85fd-c60e7ba21f81 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:05.516504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced822f8-252d-47ad-85fd-c60e7ba21f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:05.541264 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-ced822f8-252d-47ad-85fd-c60e7ba21f81 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:05.542488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ced822f8-252d-47ad-85fd-c60e7ba21f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:05.550225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 726/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:05.588650 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7973fa0-e430-4d48-a182-daf834827136 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:05.590372 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e7973fa0-e430-4d48-a182-daf834827136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:05.604633 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7973fa0-e430-4d48-a182-daf834827136 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:05.608196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483276b7-f0e8-4d3c-b7e4-4eb6571168cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:05.608855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483276b7-f0e8-4d3c-b7e4-4eb6571168cc service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:05.609135 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483276b7-f0e8-4d3c-b7e4-4eb6571168cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:05.609405 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483276b7-f0e8-4d3c-b7e4-4eb6571168cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:05.618035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483276b7-f0e8-4d3c-b7e4-4eb6571168cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:05.619486 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483276b7-f0e8-4d3c-b7e4-4eb6571168cc service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:05.629240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 721/1447] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:08.231368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a4e9-1eb5-45ed-a002-e05e372de7bc None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:08.231944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a4e9-1eb5-45ed-a002-e05e372de7bc None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:08.231944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a4e9-1eb5-45ed-a002-e05e372de7bc None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:08.233737 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 727/1448] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:32:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:08.239053 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5e9e0-3ca5-4cc1-9633-cbfbc5dbd78c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:08.239461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5e9e0-3ca5-4cc1-9633-cbfbc5dbd78c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:08.239606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5e9e0-3ca5-4cc1-9633-cbfbc5dbd78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:08.257868 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-ddc5e9e0-3ca5-4cc1-9633-cbfbc5dbd78c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:08.259067 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ddc5e9e0-3ca5-4cc1-9633-cbfbc5dbd78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:08.267220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 722/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:08.306110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190a4e9-1eb5-45ed-a002-e05e372de7bc None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:08.317324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190a4e9-1eb5-45ed-a002-e05e372de7bc None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:08.320845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17d39b-20ef-4b0e-b587-10b963265b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:08.321478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17d39b-20ef-4b0e-b587-10b963265b81 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:08.321760 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17d39b-20ef-4b0e-b587-10b963265b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:08.322034 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17d39b-20ef-4b0e-b587-10b963265b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:08.330873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17d39b-20ef-4b0e-b587-10b963265b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:08.332329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17d39b-20ef-4b0e-b587-10b963265b81 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:08.341380 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 728/1450] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:10.758963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbccdb-de4b-4bf6-98b1-0356faf20da0 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:10.759488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbccdb-de4b-4bf6-98b1-0356faf20da0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:10.759488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbccdb-de4b-4bf6-98b1-0356faf20da0 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:10.761253 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 723/1451] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:32:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:10.766512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc25e7-bae3-48b1-922b-6326cce4deeb None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:10.766917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc25e7-bae3-48b1-922b-6326cce4deeb None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:10.767059 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc25e7-bae3-48b1-922b-6326cce4deeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:10.785032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-6fbc25e7-bae3-48b1-922b-6326cce4deeb None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:10.786240 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6fbc25e7-bae3-48b1-922b-6326cce4deeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:10.793793 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 729/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:10.832167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbccdb-de4b-4bf6-98b1-0356faf20da0 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:10.842592 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbccdb-de4b-4bf6-98b1-0356faf20da0 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:10.846620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d750a-c524-4ec7-9471-84c1eebe3d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:10.847249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d750a-c524-4ec7-9471-84c1eebe3d84 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:10.847533 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d750a-c524-4ec7-9471-84c1eebe3d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:10.847804 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d750a-c524-4ec7-9471-84c1eebe3d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:10.856352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d750a-c524-4ec7-9471-84c1eebe3d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:10.857810 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d750a-c524-4ec7-9471-84c1eebe3d84 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:10.867486 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 724/1453] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:13.195195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068f4f0-4d3a-427d-b72c-6c62f0db870d None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:13.195728 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068f4f0-4d3a-427d-b72c-6c62f0db870d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:13.195844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068f4f0-4d3a-427d-b72c-6c62f0db870d None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:13.197562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 730/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:32:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:13.202835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242e934-e621-4c2f-a1ed-9ee28560b45c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:13.203361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242e934-e621-4c2f-a1ed-9ee28560b45c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:13.203477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242e934-e621-4c2f-a1ed-9ee28560b45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:13.221158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-9242e934-e621-4c2f-a1ed-9ee28560b45c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:13.222356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9242e934-e621-4c2f-a1ed-9ee28560b45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:13.229966 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 725/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:13.267669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068f4f0-4d3a-427d-b72c-6c62f0db870d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:13.278043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068f4f0-4d3a-427d-b72c-6c62f0db870d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:13.282349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980174ba-6007-43e4-9a72-8374b2746cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:13.282978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980174ba-6007-43e4-9a72-8374b2746cbe service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:13.283260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980174ba-6007-43e4-9a72-8374b2746cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:13.283537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980174ba-6007-43e4-9a72-8374b2746cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:13.292155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980174ba-6007-43e4-9a72-8374b2746cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:13.293575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980174ba-6007-43e4-9a72-8374b2746cbe service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:13.303454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 731/1456] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:15.673079 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423840ab-bc9e-43ec-b0eb-b00028547e7e None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:15.673619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423840ab-bc9e-43ec-b0eb-b00028547e7e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:15.673619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423840ab-bc9e-43ec-b0eb-b00028547e7e None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:15.675448 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 726/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:15.680867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af498d-053a-4771-9878-b88ee4ca7c75 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:15.681275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af498d-053a-4771-9878-b88ee4ca7c75 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:15.681410 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af498d-053a-4771-9878-b88ee4ca7c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:15.700360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-56af498d-053a-4771-9878-b88ee4ca7c75 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:15.701548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-56af498d-053a-4771-9878-b88ee4ca7c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:15.709447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 732/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:32:15.747185 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423840ab-bc9e-43ec-b0eb-b00028547e7e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:15.758115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423840ab-bc9e-43ec-b0eb-b00028547e7e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:15.761574 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ecbe-fd2f-47d8-8ca4-291a2725af52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:15.762223 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ecbe-fd2f-47d8-8ca4-291a2725af52 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:15.762510 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ecbe-fd2f-47d8-8ca4-291a2725af52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:15.762782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ecbe-fd2f-47d8-8ca4-291a2725af52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:15.771337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0ecbe-fd2f-47d8-8ca4-291a2725af52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:15.772755 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0ecbe-fd2f-47d8-8ca4-291a2725af52 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:15.781768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 727/1459] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:18.105337 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dce428-f43f-4ead-bfcb-0984d35a07d5 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:18.105805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dce428-f43f-4ead-bfcb-0984d35a07d5 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:18.105923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dce428-f43f-4ead-bfcb-0984d35a07d5 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:18.107696 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 733/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:18.113091 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50fbef-ab32-4c45-9465-c8efa0978bae None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:18.113477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50fbef-ab32-4c45-9465-c8efa0978bae None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:18.113642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50fbef-ab32-4c45-9465-c8efa0978bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:18.131166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4c50fbef-ab32-4c45-9465-c8efa0978bae None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:18.132328 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4c50fbef-ab32-4c45-9465-c8efa0978bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:18.140713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 728/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:18.177375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dce428-f43f-4ead-bfcb-0984d35a07d5 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:18.188133 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dce428-f43f-4ead-bfcb-0984d35a07d5 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:18.191553 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e01f2b-3d42-4b5f-a014-b630823e6165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:18.192170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01f2b-3d42-4b5f-a014-b630823e6165 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:18.192559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01f2b-3d42-4b5f-a014-b630823e6165 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:18.192835 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01f2b-3d42-4b5f-a014-b630823e6165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:18.201256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e01f2b-3d42-4b5f-a014-b630823e6165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:18.203307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e01f2b-3d42-4b5f-a014-b630823e6165 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:18.212195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 734/1462] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:20.547365 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd438651-20d2-4e4b-92a2-1936efdc8607 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:20.547906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd438651-20d2-4e4b-92a2-1936efdc8607 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:20.547906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd438651-20d2-4e4b-92a2-1936efdc8607 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:20.549678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 729/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:20.554839 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efa0a5-670c-4ae9-9143-08c6a8231196 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:20.555234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efa0a5-670c-4ae9-9143-08c6a8231196 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:20.555390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efa0a5-670c-4ae9-9143-08c6a8231196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:20.573387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-99efa0a5-670c-4ae9-9143-08c6a8231196 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:20.574596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-99efa0a5-670c-4ae9-9143-08c6a8231196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:20.582094 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 735/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:20.620841 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd438651-20d2-4e4b-92a2-1936efdc8607 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:20.631400 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd438651-20d2-4e4b-92a2-1936efdc8607 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:20.634898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fa7ba-3203-4851-9ec6-aada3458bdda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:20.635525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fa7ba-3203-4851-9ec6-aada3458bdda service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:20.635805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fa7ba-3203-4851-9ec6-aada3458bdda service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:20.636073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fa7ba-3203-4851-9ec6-aada3458bdda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:20.644689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fa7ba-3203-4851-9ec6-aada3458bdda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:20.646125 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fa7ba-3203-4851-9ec6-aada3458bdda service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:20.655290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 730/1465] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:22.978690 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3477a-2186-43fb-acd0-9b8484e0d824 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:22.979280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3477a-2186-43fb-acd0-9b8484e0d824 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:22.979280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3477a-2186-43fb-acd0-9b8484e0d824 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:22.981053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 736/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:32:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:22.986940 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca0231-ce21-4d47-9ac9-e5a0406c9c35 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:22.987365 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca0231-ce21-4d47-9ac9-e5a0406c9c35 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:22.987498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca0231-ce21-4d47-9ac9-e5a0406c9c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:23.005754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e8ca0231-ce21-4d47-9ac9-e5a0406c9c35 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:23.006944 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e8ca0231-ce21-4d47-9ac9-e5a0406c9c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:23.014622 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 731/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:32:23.051482 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3477a-2186-43fb-acd0-9b8484e0d824 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:23.061968 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3477a-2186-43fb-acd0-9b8484e0d824 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:23.065883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb961b3-703b-404a-b22b-67dbf5cea562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:23.066537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb961b3-703b-404a-b22b-67dbf5cea562 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:23.066816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb961b3-703b-404a-b22b-67dbf5cea562 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:23.067104 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb961b3-703b-404a-b22b-67dbf5cea562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:23.075603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb961b3-703b-404a-b22b-67dbf5cea562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:23.077016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb961b3-703b-404a-b22b-67dbf5cea562 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:23.086694 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 737/1468] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:25.398078 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ee87e-2dd3-4d4e-b536-a6d010eae9ff None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:25.398626 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ee87e-2dd3-4d4e-b536-a6d010eae9ff None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:25.398626 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ee87e-2dd3-4d4e-b536-a6d010eae9ff None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:25.401039 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 732/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:25.406580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a7b1d-b1b2-43ee-b64f-a53ba3037e65 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:25.407101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a7b1d-b1b2-43ee-b64f-a53ba3037e65 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:25.407211 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a7b1d-b1b2-43ee-b64f-a53ba3037e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:25.425435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-9d9a7b1d-b1b2-43ee-b64f-a53ba3037e65 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:25.426643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9d9a7b1d-b1b2-43ee-b64f-a53ba3037e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:25.434432 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 738/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:25.473138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ee87e-2dd3-4d4e-b536-a6d010eae9ff None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:25.484065 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ee87e-2dd3-4d4e-b536-a6d010eae9ff None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:25.487570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d0206-9027-421e-9417-d44a29c468c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:25.488195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d0206-9027-421e-9417-d44a29c468c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:25.488472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d0206-9027-421e-9417-d44a29c468c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:25.488742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d0206-9027-421e-9417-d44a29c468c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:25.497498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d0206-9027-421e-9417-d44a29c468c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:25.498951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d0206-9027-421e-9417-d44a29c468c3 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:25.509154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 733/1471] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:45.992979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eedf89-a2bd-4403-b616-223c512ffcfc None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:45.993585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eedf89-a2bd-4403-b616-223c512ffcfc None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:45.993585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eedf89-a2bd-4403-b616-223c512ffcfc None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:45.995352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 739/1472] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:46.001100 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1db97f-82e4-4c36-a04c-cb61dd52cb4a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:46.001542 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1db97f-82e4-4c36-a04c-cb61dd52cb4a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:46.001644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1db97f-82e4-4c36-a04c-cb61dd52cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:46.019481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-dd1db97f-82e4-4c36-a04c-cb61dd52cb4a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:46.020644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-dd1db97f-82e4-4c36-a04c-cb61dd52cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:46.028211 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 734/1473] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:46.073850 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577e4af-76f2-4f32-80fa-6fcc6f43c571 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:46.074134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577e4af-76f2-4f32-80fa-6fcc6f43c571 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:46.074446 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577e4af-76f2-4f32-80fa-6fcc6f43c571 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:46.076193 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 740/1474] 10.222.0.79 () {54 vars in 962 bytes} [Mon Feb 21 01:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:46.081661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8264a3-0d3c-41b2-a345-5a9f52b47855 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:46.081951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8264a3-0d3c-41b2-a345-5a9f52b47855 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:46.082252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8264a3-0d3c-41b2-a345-5a9f52b47855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:46.100364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-8c8264a3-0d3c-41b2-a345-5a9f52b47855 None None] MFA Rules not processed for user `e68b3bc64dc94865a72cea0988fa9c65`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:46.101524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8c8264a3-0d3c-41b2-a345-5a9f52b47855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:46.107797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 735/1475] 10.222.0.79 () {58 vars in 1059 bytes} [Mon Feb 21 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:46.114982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577e4af-76f2-4f32-80fa-6fcc6f43c571 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:46.126029 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577e4af-76f2-4f32-80fa-6fcc6f43c571 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:46.129489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b54f7-5e1b-418e-859d-bf7c7b1a1649 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68b3bc64dc94865a72cea0988fa9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:46.130112 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b54f7-5e1b-418e-859d-bf7c7b1a1649 service glance] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:46.130423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b54f7-5e1b-418e-859d-bf7c7b1a1649 service glance] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:46.130697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b54f7-5e1b-418e-859d-bf7c7b1a1649 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:46.139298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b54f7-5e1b-418e-859d-bf7c7b1a1649 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:46.141360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b54f7-5e1b-418e-859d-bf7c7b1a1649 service glance] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:46.150386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 741/1476] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:48.502884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9cbd0-eadd-4edd-b669-4393ba6dec46 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:48.503330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9cbd0-eadd-4edd-b669-4393ba6dec46 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:48.503474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9cbd0-eadd-4edd-b669-4393ba6dec46 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:48.505289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 736/1477] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:48.510388 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7a8e4-0a0c-4294-9c0a-db535ad3ffcd None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:48.510831 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7a8e4-0a0c-4294-9c0a-db535ad3ffcd None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:48.511001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7a8e4-0a0c-4294-9c0a-db535ad3ffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:48.528843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-2dd7a8e4-0a0c-4294-9c0a-db535ad3ffcd None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:48.530013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-2dd7a8e4-0a0c-4294-9c0a-db535ad3ffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:48.537591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 742/1478] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:32:48.560943 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9cbd0-eadd-4edd-b669-4393ba6dec46 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:48.573552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9cbd0-eadd-4edd-b669-4393ba6dec46 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:48.577833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6b4bd-5b52-4cf4-99c3-2ef270cf3e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:48.578501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6b4bd-5b52-4cf4-99c3-2ef270cf3e2a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:48.578781 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6b4bd-5b52-4cf4-99c3-2ef270cf3e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:48.579052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6b4bd-5b52-4cf4-99c3-2ef270cf3e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:48.579825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6b4bd-5b52-4cf4-99c3-2ef270cf3e2a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:48.581656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6b4bd-5b52-4cf4-99c3-2ef270cf3e2a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:48.594718 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 737/1479] 10.222.0.79 () {56 vars in 1108 bytes} [Mon Feb 21 01:32:48 2022] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:50.880668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a2534-2a7a-4043-860d-fe6c3b5e6f4c None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:50.881167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a2534-2a7a-4043-860d-fe6c3b5e6f4c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:50.881262 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a2534-2a7a-4043-860d-fe6c3b5e6f4c None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:50.883183 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 743/1480] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:50.888447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8422c57-7d83-4370-8d14-2b6f3e9dcbd3 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:50.888847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8422c57-7d83-4370-8d14-2b6f3e9dcbd3 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:50.888996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8422c57-7d83-4370-8d14-2b6f3e9dcbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:50.907406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-d8422c57-7d83-4370-8d14-2b6f3e9dcbd3 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:50.908582 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d8422c57-7d83-4370-8d14-2b6f3e9dcbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:50.916210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 738/1481] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:50.960411 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a2534-2a7a-4043-860d-fe6c3b5e6f4c None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:50.975035 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a2534-2a7a-4043-860d-fe6c3b5e6f4c None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:50.980286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ffc7f-54e4-45c7-85a3-6d3249900e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:50.980914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ffc7f-54e4-45c7-85a3-6d3249900e55 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:50.981194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ffc7f-54e4-45c7-85a3-6d3249900e55 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:50.981466 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ffc7f-54e4-45c7-85a3-6d3249900e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:50.989460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ffc7f-54e4-45c7-85a3-6d3249900e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:50.991071 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ffc7f-54e4-45c7-85a3-6d3249900e55 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:51.000444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 744/1482] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:53.452406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbe65e-8b38-4d21-bf06-d7774f81135c None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:53.453580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbe65e-8b38-4d21-bf06-d7774f81135c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:53.453580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbe65e-8b38-4d21-bf06-d7774f81135c None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:53.455370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 739/1483] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:53.460514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef914932-3938-4eaa-8e09-4c209dbafc1e None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:53.460937 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef914932-3938-4eaa-8e09-4c209dbafc1e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:53.461056 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef914932-3938-4eaa-8e09-4c209dbafc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:53.478247 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-ef914932-3938-4eaa-8e09-4c209dbafc1e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:53.479408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ef914932-3938-4eaa-8e09-4c209dbafc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:53.486838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 745/1484] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:53.523637 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbe65e-8b38-4d21-bf06-d7774f81135c None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:53.534186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbe65e-8b38-4d21-bf06-d7774f81135c None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:53.537712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adcf75-e606-41cd-baf5-28e660a9fba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:53.538399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adcf75-e606-41cd-baf5-28e660a9fba5 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:53.538682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adcf75-e606-41cd-baf5-28e660a9fba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:53.538957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adcf75-e606-41cd-baf5-28e660a9fba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:53.547796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adcf75-e606-41cd-baf5-28e660a9fba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:53.549226 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adcf75-e606-41cd-baf5-28e660a9fba5 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:53.558451 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 740/1485] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:32:55.901491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014550f4-ba97-4ffc-9285-302027cf2029 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:55.902060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014550f4-ba97-4ffc-9285-302027cf2029 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:55.902060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014550f4-ba97-4ffc-9285-302027cf2029 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:55.903875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 746/1486] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:55.909737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92971a80-d02e-4918-935e-d0ae6acbf58f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:55.910159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92971a80-d02e-4918-935e-d0ae6acbf58f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:55.910328 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92971a80-d02e-4918-935e-d0ae6acbf58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:55.928781 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-92971a80-d02e-4918-935e-d0ae6acbf58f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:55.929955 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-92971a80-d02e-4918-935e-d0ae6acbf58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:55.942047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 741/1487] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:55.979626 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014550f4-ba97-4ffc-9285-302027cf2029 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:55.990804 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014550f4-ba97-4ffc-9285-302027cf2029 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:55.994281 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964bb50-cd25-4966-8af9-0cdb3a7136bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:55.994936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964bb50-cd25-4966-8af9-0cdb3a7136bc service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:55.995226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964bb50-cd25-4966-8af9-0cdb3a7136bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:55.995749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964bb50-cd25-4966-8af9-0cdb3a7136bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:56.006022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964bb50-cd25-4966-8af9-0cdb3a7136bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:56.007498 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964bb50-cd25-4966-8af9-0cdb3a7136bc service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:56.016700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 747/1488] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:58.440211 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454ab7f-0ed3-4677-8222-32d3a48f255c None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:58.440763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454ab7f-0ed3-4677-8222-32d3a48f255c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:58.440893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454ab7f-0ed3-4677-8222-32d3a48f255c None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:58.442641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 742/1489] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:58.447662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f99d-c9bd-4b94-8f66-813f79296381 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:58.448070 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f99d-c9bd-4b94-8f66-813f79296381 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:58.448203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f99d-c9bd-4b94-8f66-813f79296381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:58.465302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-7476f99d-c9bd-4b94-8f66-813f79296381 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:58.466486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7476f99d-c9bd-4b94-8f66-813f79296381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:58.474012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 748/1490] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:58.514269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454ab7f-0ed3-4677-8222-32d3a48f255c None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:58.524625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454ab7f-0ed3-4677-8222-32d3a48f255c None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:58.528111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2d0a1-1fca-416e-b9a5-be12174ef9c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:58.528740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2d0a1-1fca-416e-b9a5-be12174ef9c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:58.529023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2d0a1-1fca-416e-b9a5-be12174ef9c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:58.529299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2d0a1-1fca-416e-b9a5-be12174ef9c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:58.538170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2d0a1-1fca-416e-b9a5-be12174ef9c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:58.539616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2d0a1-1fca-416e-b9a5-be12174ef9c8 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:58.549286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 743/1491] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:01.029486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc40b-98c7-4d9b-a60e-8ba78f1c2d0b None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.030050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc40b-98c7-4d9b-a60e-8ba78f1c2d0b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.030050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc40b-98c7-4d9b-a60e-8ba78f1c2d0b None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.031961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 749/1492] 10.222.0.79 () {54 vars in 926 bytes} [Mon Feb 21 01:33:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:33:01.037313 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d292fa9-c768-40f7-b7e8-444c8ec5bb80 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.037717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d292fa9-c768-40f7-b7e8-444c8ec5bb80 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.037853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d292fa9-c768-40f7-b7e8-444c8ec5bb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.054972 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-3d292fa9-c768-40f7-b7e8-444c8ec5bb80 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:01.056127 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3d292fa9-c768-40f7-b7e8-444c8ec5bb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:01.064174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 744/1493] 10.222.0.79 () {58 vars in 1023 bytes} [Mon Feb 21 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:01.102438 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdc40b-98c7-4d9b-a60e-8ba78f1c2d0b None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:01.113073 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdc40b-98c7-4d9b-a60e-8ba78f1c2d0b None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:01.116663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a444a54-9d4b-4f2d-96e9-d7a58ccd4d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:01.117291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a444a54-9d4b-4f2d-96e9-d7a58ccd4d40 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.117577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a444a54-9d4b-4f2d-96e9-d7a58ccd4d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.117852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a444a54-9d4b-4f2d-96e9-d7a58ccd4d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.127361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a444a54-9d4b-4f2d-96e9-d7a58ccd4d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:01.128791 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a444a54-9d4b-4f2d-96e9-d7a58ccd4d40 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:01.138159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 750/1494] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:34:22.913306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f45fe-5137-40d0-9ea1-0f013515f3d2 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:22.913867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f45fe-5137-40d0-9ea1-0f013515f3d2 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:22.913867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f45fe-5137-40d0-9ea1-0f013515f3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:22.931654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-ae2f45fe-5137-40d0-9ea1-0f013515f3d2 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:22.932842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ae2f45fe-5137-40d0-9ea1-0f013515f3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:22.940429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 745/1495] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:22.948418 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453d915-9ec9-4249-a584-8d83da71bf01 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:22.948882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453d915-9ec9-4249-a584-8d83da71bf01 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:22.948985 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453d915-9ec9-4249-a584-8d83da71bf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:22.966877 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-1453d915-9ec9-4249-a584-8d83da71bf01 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:22.968034 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1453d915-9ec9-4249-a584-8d83da71bf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:22.975633 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 751/1496] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:22.979884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f45fe-5137-40d0-9ea1-0f013515f3d2 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:22.989570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f45fe-5137-40d0-9ea1-0f013515f3d2 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:22.993957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e4cef-759e-4da3-823a-2a8a6bea760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:22.994642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e4cef-759e-4da3-823a-2a8a6bea760c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:22.994919 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e4cef-759e-4da3-823a-2a8a6bea760c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:22.995189 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e4cef-759e-4da3-823a-2a8a6bea760c admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:22.996160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e4cef-759e-4da3-823a-2a8a6bea760c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:34:22.996467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e4cef-759e-4da3-823a-2a8a6bea760c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:22.998048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e4cef-759e-4da3-823a-2a8a6bea760c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:23.009123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 746/1497] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:34:23.016860 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453d915-9ec9-4249-a584-8d83da71bf01 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:23.025730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453d915-9ec9-4249-a584-8d83da71bf01 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:23.030782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259435d9-5ac6-4c8e-9518-92779f15e34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:23.031419 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259435d9-5ac6-4c8e-9518-92779f15e34f admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:23.031701 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259435d9-5ac6-4c8e-9518-92779f15e34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:23.031977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259435d9-5ac6-4c8e-9518-92779f15e34f admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:23.032658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259435d9-5ac6-4c8e-9518-92779f15e34f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:23.034599 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259435d9-5ac6-4c8e-9518-92779f15e34f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:23.069694 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 752/1498] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:34:23 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:34:23.073813 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e4cef-759e-4da3-823a-2a8a6bea760c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:23.083977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e4cef-759e-4da3-823a-2a8a6bea760c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:23.138706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652738e4-26c5-42a0-8f76-1ee8cc518336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:23.139376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652738e4-26c5-42a0-8f76-1ee8cc518336 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:23.139681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652738e4-26c5-42a0-8f76-1ee8cc518336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:23.139935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652738e4-26c5-42a0-8f76-1ee8cc518336 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:23.140628 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652738e4-26c5-42a0-8f76-1ee8cc518336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:23.142565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652738e4-26c5-42a0-8f76-1ee8cc518336 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:23.161027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 747/1499] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:34:23 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:34:23.166630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259435d9-5ac6-4c8e-9518-92779f15e34f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:23.176537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259435d9-5ac6-4c8e-9518-92779f15e34f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:23.180978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c6a5c-9844-45f0-bd91-ebf4a3beea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:23.181626 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c6a5c-9844-45f0-bd91-ebf4a3beea76 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:23.181906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c6a5c-9844-45f0-bd91-ebf4a3beea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:23.182181 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c6a5c-9844-45f0-bd91-ebf4a3beea76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:23.182928 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c6a5c-9844-45f0-bd91-ebf4a3beea76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:23.184515 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c6a5c-9844-45f0-bd91-ebf4a3beea76 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:23.197365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 753/1500] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:34:23.201968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652738e4-26c5-42a0-8f76-1ee8cc518336 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:23.211524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652738e4-26c5-42a0-8f76-1ee8cc518336 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:23.216509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546067be-8aca-45c4-8c22-6d38263ae7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:23.217144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546067be-8aca-45c4-8c22-6d38263ae7de admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:23.217418 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546067be-8aca-45c4-8c22-6d38263ae7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:23.217683 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546067be-8aca-45c4-8c22-6d38263ae7de admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:23.218425 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546067be-8aca-45c4-8c22-6d38263ae7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:23.220027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546067be-8aca-45c4-8c22-6d38263ae7de admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:23.232677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 748/1501] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:34:23.236602 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c6a5c-9844-45f0-bd91-ebf4a3beea76 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:23.246398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c6a5c-9844-45f0-bd91-ebf4a3beea76 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:23.250807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34f5de-0af9-4bce-8e68-269e3b461565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:23.251675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34f5de-0af9-4bce-8e68-269e3b461565 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:23.251953 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34f5de-0af9-4bce-8e68-269e3b461565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:23.252226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34f5de-0af9-4bce-8e68-269e3b461565 admin admin] PATH_INFO: `/v3/projects/6d746ea747594e358169a0179e106bf1/users/0d002cf0b6d649798db6da0af374ec1a/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:23.267660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34f5de-0af9-4bce-8e68-269e3b461565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d746ea747594e358169a0179e106bf1, user_id=0d002cf0b6d649798db6da0af374ec1a, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:23.270349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34f5de-0af9-4bce-8e68-269e3b461565 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:23.283020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 754/1502] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:34:23 2022] PUT /identity/v3/projects/6d746ea747594e358169a0179e106bf1/users/0d002cf0b6d649798db6da0af374ec1a/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:34:23.293769 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78400126-4106-4f2a-98c0-041c7a31e99f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:23.294056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78400126-4106-4f2a-98c0-041c7a31e99f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:23.294378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78400126-4106-4f2a-98c0-041c7a31e99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:23.320326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-78400126-4106-4f2a-98c0-041c7a31e99f None None] MFA Rules not processed for user `0d002cf0b6d649798db6da0af374ec1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:23.321516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-78400126-4106-4f2a-98c0-041c7a31e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:23.382188 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 749/1503] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:34:23.393591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34f5de-0af9-4bce-8e68-269e3b461565 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:23.461858 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34f5de-0af9-4bce-8e68-269e3b461565 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:23.467282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd98ae-c29b-4f67-92c7-d8beef36cb10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:23.467915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd98ae-c29b-4f67-92c7-d8beef36cb10 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:23.468194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd98ae-c29b-4f67-92c7-d8beef36cb10 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:23.468466 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd98ae-c29b-4f67-92c7-d8beef36cb10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:23.475826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd98ae-c29b-4f67-92c7-d8beef36cb10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:23.477384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd98ae-c29b-4f67-92c7-d8beef36cb10 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:23.485773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 755/1504] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:34:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:34:23.552579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e8da0-72ec-4a3c-be7a-94be0f139749 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:23.552869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e8da0-72ec-4a3c-be7a-94be0f139749 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:23.553151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e8da0-72ec-4a3c-be7a-94be0f139749 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:23.554886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 750/1505] 10.222.0.79 () {52 vars in 829 bytes} [Mon Feb 21 01:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:34:23.558382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd98ae-c29b-4f67-92c7-d8beef36cb10 service nova] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:23.616052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd98ae-c29b-4f67-92c7-d8beef36cb10 service nova] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:23.623291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:23.624526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:23.624806 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:23.625204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] PATH_INFO: `/v3/users/0d002cf0b6d649798db6da0af374ec1a` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:23.627022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d002cf0b6d649798db6da0af374ec1a)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:23.628433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:34:23.628433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:34:23.628433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:34:23.630150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:23.693319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d002cf0b6d649798db6da0af374ec1a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:23.702923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d002cf0b6d649798db6da0af374ec1a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:23.725615 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d002cf0b6d649798db6da0af374ec1a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:23.726260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d002cf0b6d649798db6da0af374ec1a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:23.738150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d002cf0b6d649798db6da0af374ec1a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:23.744256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 756/1506] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:34:23 2022] DELETE /identity/v3/users/0d002cf0b6d649798db6da0af374ec1a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:23.749554 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd585b-600e-437a-95e3-61223467c70c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:23.749839 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd585b-600e-437a-95e3-61223467c70c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:23.750114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd585b-600e-437a-95e3-61223467c70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:23.768476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-8bfd585b-600e-437a-95e3-61223467c70c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:23.769650 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8bfd585b-600e-437a-95e3-61223467c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:23.824635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 751/1507] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:23.834255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:23.835641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:23.889110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc70ad-a56c-4fa4-9ebd-cb46831da972 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:23.892605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506bf15-575e-486a-aaed-f4ef4167b547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:23.893234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506bf15-575e-486a-aaed-f4ef4167b547 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:23.893510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506bf15-575e-486a-aaed-f4ef4167b547 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:23.893780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506bf15-575e-486a-aaed-f4ef4167b547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:23.902269 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506bf15-575e-486a-aaed-f4ef4167b547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:23.903691 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506bf15-575e-486a-aaed-f4ef4167b547 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:23.912683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 757/1508] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:34:24.231808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd585b-600e-437a-95e3-61223467c70c None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:24.233263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8bfd585b-600e-437a-95e3-61223467c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:24.244696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd585b-600e-437a-95e3-61223467c70c None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:24.250494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:24.251353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:24.251669 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:24.251894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] PATH_INFO: `/v3/projects/6d746ea747594e358169a0179e106bf1` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:24.253134 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d746ea747594e358169a0179e106bf1)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:24.254165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:34:24.254165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:34:24.254165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:34:24.255372 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:24.316458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d746ea747594e358169a0179e106bf1', 'request_id': 'req-00b25057-f345-499b-92dd-3fbf769aef64'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:24.329178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d746ea747594e358169a0179e106bf1', 'request_id': 'req-00b25057-f345-499b-92dd-3fbf769aef64'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:24.338502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d746ea747594e358169a0179e106bf1', 'request_id': 'req-00b25057-f345-499b-92dd-3fbf769aef64'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:24.349525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] The token cache is being invalidate because project 6d746ea747594e358169a0179e106bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:34:24.349819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:24.350524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-00b25057-f345-499b-92dd-3fbf769aef64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:24.352060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 752/1509] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:34:24 2022] DELETE /identity/v3/projects/6d746ea747594e358169a0179e106bf1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:01.616117 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7636bde-5230-4f37-ba45-c23697159873 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:01.616709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7636bde-5230-4f37-ba45-c23697159873 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:01.616709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7636bde-5230-4f37-ba45-c23697159873 None None] PATH_INFO: `/v3` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:01.617980 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 758/1510] 10.222.0.73 () {54 vars in 925 bytes} [Mon Feb 21 01:36:01 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:36:01.624714 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06179a7-eddd-40e2-a9be-ac2002900b32 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:01.625192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06179a7-eddd-40e2-a9be-ac2002900b32 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:01.625397 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06179a7-eddd-40e2-a9be-ac2002900b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:01.646017 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-b06179a7-eddd-40e2-a9be-ac2002900b32 None None] MFA Rules not processed for user `02e7385005924d4f8c220c986b9866de`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:01.647244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b06179a7-eddd-40e2-a9be-ac2002900b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:01.677395 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0695-0606-4612-ad80-805cbba6d5eb None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:01.677723 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0695-0606-4612-ad80-805cbba6d5eb None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:01.677992 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0695-0606-4612-ad80-805cbba6d5eb None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:01.679804 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:36:01.684982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7a671-e145-4b0b-8393-0c41e68a368b None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:01.685261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7a671-e145-4b0b-8393-0c41e68a368b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:01.685532 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7a671-e145-4b0b-8393-0c41e68a368b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:01.703545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-73d7a671-e145-4b0b-8393-0c41e68a368b None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:01.704722 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-73d7a671-e145-4b0b-8393-0c41e68a368b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:01.709947 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 753/1512] 10.222.0.73 () {58 vars in 1015 bytes} [Mon Feb 21 01:36:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:01.763027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 760/1513] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:01.922481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06179a7-eddd-40e2-a9be-ac2002900b32 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:01.923855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b06179a7-eddd-40e2-a9be-ac2002900b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:01.993217 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06179a7-eddd-40e2-a9be-ac2002900b32 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:01.999488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8fabf-a563-4fd4-a868-e21368d6fcec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:02.000137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8fabf-a563-4fd4-a868-e21368d6fcec service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:02.000422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8fabf-a563-4fd4-a868-e21368d6fcec service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:02.000701 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8fabf-a563-4fd4-a868-e21368d6fcec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:02.008672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8fabf-a563-4fd4-a868-e21368d6fcec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:02.010901 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8fabf-a563-4fd4-a868-e21368d6fcec service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:02.020322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 754/1514] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:03.302381 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23eee5-f62e-4527-ac46-1fca7e08b4c5 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.302960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23eee5-f62e-4527-ac46-1fca7e08b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.302960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23eee5-f62e-4527-ac46-1fca7e08b4c5 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:03.304715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 761/1515] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:36:03.310308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ce401-6e24-464e-bec4-80f99e521e8f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.310742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ce401-6e24-464e-bec4-80f99e521e8f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.310844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ce401-6e24-464e-bec4-80f99e521e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:03.328972 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-389ce401-6e24-464e-bec4-80f99e521e8f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:03.330170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-389ce401-6e24-464e-bec4-80f99e521e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:03.337960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 755/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:03.490963 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23eee5-f62e-4527-ac46-1fca7e08b4c5 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:03.505734 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23eee5-f62e-4527-ac46-1fca7e08b4c5 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:03.511767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c8dd4-6aeb-48ab-8afd-920b31887c9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:03.512393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c8dd4-6aeb-48ab-8afd-920b31887c9a service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.512674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c8dd4-6aeb-48ab-8afd-920b31887c9a service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.512946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c8dd4-6aeb-48ab-8afd-920b31887c9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:03.520750 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c8dd4-6aeb-48ab-8afd-920b31887c9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:03.522469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c8dd4-6aeb-48ab-8afd-920b31887c9a service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:03.531463 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 762/1517] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:05.591036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4650a-8a3d-4a7c-9790-e0bec2bdeb80 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:05.591593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4650a-8a3d-4a7c-9790-e0bec2bdeb80 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:05.591593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4650a-8a3d-4a7c-9790-e0bec2bdeb80 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:05.593344 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 756/1518] 10.222.0.79 () {54 vars in 960 bytes} [Mon Feb 21 01:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:36:05.598344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe08e-d522-4b4c-ac09-f2b6c73d5efb None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:05.598765 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe08e-d522-4b4c-ac09-f2b6c73d5efb None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:05.598902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe08e-d522-4b4c-ac09-f2b6c73d5efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:05.616361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-d82fe08e-d522-4b4c-ac09-f2b6c73d5efb None None] MFA Rules not processed for user `02e7385005924d4f8c220c986b9866de`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:05.617558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-d82fe08e-d522-4b4c-ac09-f2b6c73d5efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:05.627433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 763/1519] 10.222.0.79 () {58 vars in 1057 bytes} [Mon Feb 21 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:05.635338 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4650a-8a3d-4a7c-9790-e0bec2bdeb80 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:05.648062 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4650a-8a3d-4a7c-9790-e0bec2bdeb80 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:05.652903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c34238-64b1-4d81-bcb7-9e9700222a6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02e7385005924d4f8c220c986b9866de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:05.653523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c34238-64b1-4d81-bcb7-9e9700222a6e service placement] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:05.653800 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c34238-64b1-4d81-bcb7-9e9700222a6e service placement] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:05.654071 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c34238-64b1-4d81-bcb7-9e9700222a6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:05.664937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c34238-64b1-4d81-bcb7-9e9700222a6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:05.667337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c34238-64b1-4d81-bcb7-9e9700222a6e service placement] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:05.676669 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 757/1520] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:15.232315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4580ec0-3b68-4fce-ad98-4b5eff2b4272 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:15.232893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4580ec0-3b68-4fce-ad98-4b5eff2b4272 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:15.232893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4580ec0-3b68-4fce-ad98-4b5eff2b4272 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:15.234668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 764/1521] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:36:15.239691 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463935d7-af6f-4770-9694-7ca09845fc4e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:15.240113 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463935d7-af6f-4770-9694-7ca09845fc4e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:15.240251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463935d7-af6f-4770-9694-7ca09845fc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:15.258482 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-463935d7-af6f-4770-9694-7ca09845fc4e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:15.259651 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-463935d7-af6f-4770-9694-7ca09845fc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:15.267945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 758/1522] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:15.418906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4580ec0-3b68-4fce-ad98-4b5eff2b4272 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:15.433580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4580ec0-3b68-4fce-ad98-4b5eff2b4272 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:15.438972 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e277ea1-7933-4df9-b73a-4ff5a4904dcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:15.439599 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e277ea1-7933-4df9-b73a-4ff5a4904dcf service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:15.439880 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e277ea1-7933-4df9-b73a-4ff5a4904dcf service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:15.440153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e277ea1-7933-4df9-b73a-4ff5a4904dcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:15.448684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e277ea1-7933-4df9-b73a-4ff5a4904dcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:15.450282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e277ea1-7933-4df9-b73a-4ff5a4904dcf service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:15.459452 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 765/1523] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:16.734483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502965e-2904-455b-a363-28638dbd2e05 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:16.735052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502965e-2904-455b-a363-28638dbd2e05 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:16.735052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502965e-2904-455b-a363-28638dbd2e05 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:16.736796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 759/1524] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:36:16.741617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c805f8-4611-4f2e-abd4-fd7b260cacf6 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:16.742028 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c805f8-4611-4f2e-abd4-fd7b260cacf6 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:16.742153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c805f8-4611-4f2e-abd4-fd7b260cacf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:16.761910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-19c805f8-4611-4f2e-abd4-fd7b260cacf6 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:16.763127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-19c805f8-4611-4f2e-abd4-fd7b260cacf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:16.770750 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 766/1525] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:16.922702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502965e-2904-455b-a363-28638dbd2e05 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:16.938027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502965e-2904-455b-a363-28638dbd2e05 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:16.943733 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bf249-80d0-452d-bf37-7c89dbacea43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:16.944370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bf249-80d0-452d-bf37-7c89dbacea43 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:16.944848 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bf249-80d0-452d-bf37-7c89dbacea43 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:16.945121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bf249-80d0-452d-bf37-7c89dbacea43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:16.953757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bf249-80d0-452d-bf37-7c89dbacea43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:16.955433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bf249-80d0-452d-bf37-7c89dbacea43 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:16.965164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 760/1526] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:21.226545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174b5cf-3ee5-419f-a95c-c26e3be29b82 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:21.227113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174b5cf-3ee5-419f-a95c-c26e3be29b82 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:21.227113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174b5cf-3ee5-419f-a95c-c26e3be29b82 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:21.228927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 767/1527] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:36:21.234110 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd8267-5c43-4857-9c44-6480eb94c7eb None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:21.234580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd8267-5c43-4857-9c44-6480eb94c7eb None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:21.234730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd8267-5c43-4857-9c44-6480eb94c7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:21.254262 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f7cd8267-5c43-4857-9c44-6480eb94c7eb None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:21.255424 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f7cd8267-5c43-4857-9c44-6480eb94c7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:21.265392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 761/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:21.300637 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174b5cf-3ee5-419f-a95c-c26e3be29b82 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:21.302336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-d174b5cf-3ee5-419f-a95c-c26e3be29b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:21.357475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174b5cf-3ee5-419f-a95c-c26e3be29b82 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:21.360886 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25446ae1-a6a6-4dc1-b7dc-c6eb5c2595aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:21.361520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25446ae1-a6a6-4dc1-b7dc-c6eb5c2595aa service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:21.361796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25446ae1-a6a6-4dc1-b7dc-c6eb5c2595aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:21.362063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25446ae1-a6a6-4dc1-b7dc-c6eb5c2595aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:21.371439 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25446ae1-a6a6-4dc1-b7dc-c6eb5c2595aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:21.372852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25446ae1-a6a6-4dc1-b7dc-c6eb5c2595aa service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:21.381888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 768/1529] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:23.675076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a0032-4f82-420b-bb10-cf137a287fde None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:23.675637 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a0032-4f82-420b-bb10-cf137a287fde None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:23.675637 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a0032-4f82-420b-bb10-cf137a287fde None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:23.677400 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 762/1530] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:36:23.682931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce06b-9c74-4992-9b7f-54bb9a681c91 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:23.683318 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce06b-9c74-4992-9b7f-54bb9a681c91 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:23.683475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce06b-9c74-4992-9b7f-54bb9a681c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:23.701227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-d71ce06b-9c74-4992-9b7f-54bb9a681c91 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:23.702450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-d71ce06b-9c74-4992-9b7f-54bb9a681c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:23.709925 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 769/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:23.746369 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a0032-4f82-420b-bb10-cf137a287fde None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:23.756600 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a0032-4f82-420b-bb10-cf137a287fde None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:23.760147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8961260-82e3-4db4-b5b0-4c4620941bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:23.760782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8961260-82e3-4db4-b5b0-4c4620941bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:23.761058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8961260-82e3-4db4-b5b0-4c4620941bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:23.761329 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8961260-82e3-4db4-b5b0-4c4620941bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:23.771162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8961260-82e3-4db4-b5b0-4c4620941bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:23.772588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8961260-82e3-4db4-b5b0-4c4620941bf3 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:23.781737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 763/1532] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:27.636465 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544a023-e6bd-4b88-88fb-eafb0bd886f2 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:27.638640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544a023-e6bd-4b88-88fb-eafb0bd886f2 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:27.639164 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544a023-e6bd-4b88-88fb-eafb0bd886f2 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:27.642318 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 770/1533] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:36:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:36:27.647961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e800083-47c0-439b-a9df-fe41a70969a8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:27.648433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e800083-47c0-439b-a9df-fe41a70969a8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:27.648527 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e800083-47c0-439b-a9df-fe41a70969a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:27.666430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0e800083-47c0-439b-a9df-fe41a70969a8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:27.667583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0e800083-47c0-439b-a9df-fe41a70969a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:27.675142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 764/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:27.925184 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544a023-e6bd-4b88-88fb-eafb0bd886f2 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:27.926909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9544a023-e6bd-4b88-88fb-eafb0bd886f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:27.981815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544a023-e6bd-4b88-88fb-eafb0bd886f2 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:27.985390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db608d0-84a1-420a-a236-87cc6a77ee9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:27.986014 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db608d0-84a1-420a-a236-87cc6a77ee9f service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:27.986331 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db608d0-84a1-420a-a236-87cc6a77ee9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:27.986603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db608d0-84a1-420a-a236-87cc6a77ee9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:27.997419 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db608d0-84a1-420a-a236-87cc6a77ee9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:27.998880 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db608d0-84a1-420a-a236-87cc6a77ee9f service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:28.008336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 771/1535] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:30.315880 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d1e0f-673f-407f-a1ec-1f6879d09177 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:30.316388 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d1e0f-673f-407f-a1ec-1f6879d09177 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:30.316388 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d1e0f-673f-407f-a1ec-1f6879d09177 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:30.318096 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 765/1536] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:36:30.323463 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f052e6-12f3-47fc-85b2-914a854d90b1 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:30.323895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f052e6-12f3-47fc-85b2-914a854d90b1 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:30.323999 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f052e6-12f3-47fc-85b2-914a854d90b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:30.341802 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a4f052e6-12f3-47fc-85b2-914a854d90b1 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:30.343024 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a4f052e6-12f3-47fc-85b2-914a854d90b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:30.350850 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 772/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:30.602824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff291b-646e-4cc0-be99-5d65044b8a86 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:30.603114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff291b-646e-4cc0-be99-5d65044b8a86 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:30.603389 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff291b-646e-4cc0-be99-5d65044b8a86 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:30.605150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 766/1538] 10.222.0.79 () {54 vars in 963 bytes} [Mon Feb 21 01:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:36:30.609972 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8438e4-4cf4-45f9-870f-db2830c39c59 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:30.610292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8438e4-4cf4-45f9-870f-db2830c39c59 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:30.610570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8438e4-4cf4-45f9-870f-db2830c39c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:30.629373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-6a8438e4-4cf4-45f9-870f-db2830c39c59 None None] MFA Rules not processed for user `48ca95750bea45019bdc0b34b8f445df`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:30.630592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6a8438e4-4cf4-45f9-870f-db2830c39c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:30.637452 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 773/1539] 10.222.0.79 () {58 vars in 1060 bytes} [Mon Feb 21 01:36:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:30.644887 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff291b-646e-4cc0-be99-5d65044b8a86 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:30.656036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff291b-646e-4cc0-be99-5d65044b8a86 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:30.659746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca2448-5dcc-4660-a767-8679c0cac276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:30.660367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca2448-5dcc-4660-a767-8679c0cac276 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:30.660645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca2448-5dcc-4660-a767-8679c0cac276 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:30.660920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca2448-5dcc-4660-a767-8679c0cac276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:30.669499 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca2448-5dcc-4660-a767-8679c0cac276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:30.670943 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca2448-5dcc-4660-a767-8679c0cac276 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:30.679820 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 767/1540] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:37:54.738436 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4433b-12d7-4fb7-b23c-973884141960 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:54.740578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4433b-12d7-4fb7-b23c-973884141960 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:54.740578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4433b-12d7-4fb7-b23c-973884141960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:54.761011 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-68d4433b-12d7-4fb7-b23c-973884141960 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:54.762194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-68d4433b-12d7-4fb7-b23c-973884141960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:54.772824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 774/1541] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:54.781846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2e821-ac77-4942-89f0-a142e3d4611f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:54.782414 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2e821-ac77-4942-89f0-a142e3d4611f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:54.782414 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2e821-ac77-4942-89f0-a142e3d4611f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:54.804886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-dfc2e821-ac77-4942-89f0-a142e3d4611f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:54.806653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-dfc2e821-ac77-4942-89f0-a142e3d4611f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:54.818743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 768/1542] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:54.824638 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4433b-12d7-4fb7-b23c-973884141960 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:54.840285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4433b-12d7-4fb7-b23c-973884141960 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:54.848303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0471d-ead6-4beb-b24f-5a5dfac817a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:54.849013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0471d-ead6-4beb-b24f-5a5dfac817a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:54.849380 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0471d-ead6-4beb-b24f-5a5dfac817a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:54.849657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0471d-ead6-4beb-b24f-5a5dfac817a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:54.850692 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0471d-ead6-4beb-b24f-5a5dfac817a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:54.850996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0471d-ead6-4beb-b24f-5a5dfac817a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:54.852665 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0471d-ead6-4beb-b24f-5a5dfac817a8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:54.871362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 775/1543] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:54.879464 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2e821-ac77-4942-89f0-a142e3d4611f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:54.896234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2e821-ac77-4942-89f0-a142e3d4611f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:54.900979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bba9f-843b-4ad2-ba66-1b15213d1d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:54.901583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bba9f-843b-4ad2-ba66-1b15213d1d28 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:54.901860 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bba9f-843b-4ad2-ba66-1b15213d1d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:54.902131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bba9f-843b-4ad2-ba66-1b15213d1d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:54.903320 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bba9f-843b-4ad2-ba66-1b15213d1d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:54.905233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bba9f-843b-4ad2-ba66-1b15213d1d28 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:54.957653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 769/1544] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:54 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:54.961871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0471d-ead6-4beb-b24f-5a5dfac817a8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:54.974773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0471d-ead6-4beb-b24f-5a5dfac817a8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.019421 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6881-b9c3-4cd0-b949-bd8dfce60ffc None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.019766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6881-b9c3-4cd0-b949-bd8dfce60ffc None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.019955 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6881-b9c3-4cd0-b949-bd8dfce60ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.052219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e63d6881-b9c3-4cd0-b949-bd8dfce60ffc None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.053438 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e63d6881-b9c3-4cd0-b949-bd8dfce60ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.097404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753a268-9037-40ab-b4e9-3ae9d6952700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.097404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753a268-9037-40ab-b4e9-3ae9d6952700 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.097404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753a268-9037-40ab-b4e9-3ae9d6952700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.097404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753a268-9037-40ab-b4e9-3ae9d6952700 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.098472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753a268-9037-40ab-b4e9-3ae9d6952700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.100562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753a268-9037-40ab-b4e9-3ae9d6952700 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.156750 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 770/1545] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.166857 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ad45f-96e2-45e0-a6b0-3b30c9b41dd0 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.167460 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ad45f-96e2-45e0-a6b0-3b30c9b41dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.167997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ad45f-96e2-45e0-a6b0-3b30c9b41dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.168237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 776/1546] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:54 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:55.172572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753a268-9037-40ab-b4e9-3ae9d6952700 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.188773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753a268-9037-40ab-b4e9-3ae9d6952700 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.193663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-b56ad45f-96e2-45e0-a6b0-3b30c9b41dd0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.198114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b56ad45f-96e2-45e0-a6b0-3b30c9b41dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.203747 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f932dff-aef3-4fe2-afc0-72538a4fe092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.205445 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f932dff-aef3-4fe2-afc0-72538a4fe092 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.206623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f932dff-aef3-4fe2-afc0-72538a4fe092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.207494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f932dff-aef3-4fe2-afc0-72538a4fe092 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.209814 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f932dff-aef3-4fe2-afc0-72538a4fe092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.213705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f932dff-aef3-4fe2-afc0-72538a4fe092 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.221299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 771/1547] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:37:55.229342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f122d9f-ab2f-4a97-87bf-e9bc268c61eb None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.230057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f122d9f-ab2f-4a97-87bf-e9bc268c61eb None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.230589 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f122d9f-ab2f-4a97-87bf-e9bc268c61eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.241516 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 777/1548] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:37:55.246776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f932dff-aef3-4fe2-afc0-72538a4fe092 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.270302 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4f122d9f-ab2f-4a97-87bf-e9bc268c61eb None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.273483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f932dff-aef3-4fe2-afc0-72538a4fe092 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.275406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4f122d9f-ab2f-4a97-87bf-e9bc268c61eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.283070 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a03f69-feb0-4042-a3f6-4bb260c42925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.283816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03f69-feb0-4042-a3f6-4bb260c42925 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.284148 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03f69-feb0-4042-a3f6-4bb260c42925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.284427 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03f69-feb0-4042-a3f6-4bb260c42925 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.285161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a03f69-feb0-4042-a3f6-4bb260c42925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:55.285965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a03f69-feb0-4042-a3f6-4bb260c42925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.287645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a03f69-feb0-4042-a3f6-4bb260c42925 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.300630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 772/1549] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.305402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f122d9f-ab2f-4a97-87bf-e9bc268c61eb None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.330753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 778/1550] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:55.332211 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75775b2b-166d-4dda-b4de-cddf9429fa39 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.332502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75775b2b-166d-4dda-b4de-cddf9429fa39 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.332782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75775b2b-166d-4dda-b4de-cddf9429fa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.334352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f122d9f-ab2f-4a97-87bf-e9bc268c61eb None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.347675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157b76b-0914-4334-8ac0-e1cd4d6d5072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.348353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157b76b-0914-4334-8ac0-e1cd4d6d5072 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.348658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157b76b-0914-4334-8ac0-e1cd4d6d5072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.348937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157b76b-0914-4334-8ac0-e1cd4d6d5072 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.349662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157b76b-0914-4334-8ac0-e1cd4d6d5072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.351559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157b76b-0914-4334-8ac0-e1cd4d6d5072 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.360888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-75775b2b-166d-4dda-b4de-cddf9429fa39 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.362462 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 773/1551] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:55.363548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-75775b2b-166d-4dda-b4de-cddf9429fa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.363738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736112f-0f04-4824-a4c2-3eeaa784be84 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.364030 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736112f-0f04-4824-a4c2-3eeaa784be84 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.364311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736112f-0f04-4824-a4c2-3eeaa784be84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.374671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 779/1552] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.375842 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75775b2b-166d-4dda-b4de-cddf9429fa39 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.384411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-b736112f-0f04-4824-a4c2-3eeaa784be84 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.385630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b736112f-0f04-4824-a4c2-3eeaa784be84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.388295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75775b2b-166d-4dda-b4de-cddf9429fa39 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.395441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 774/1553] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.397983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b073fb-616a-4186-948d-a96590d13b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.397983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b073fb-616a-4186-948d-a96590d13b8e admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.397983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b073fb-616a-4186-948d-a96590d13b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.398308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbabe9-f2d9-46a5-ae0e-7bca09d85723 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.398388 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b073fb-616a-4186-948d-a96590d13b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.398472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbabe9-f2d9-46a5-ae0e-7bca09d85723 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.398472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbabe9-f2d9-46a5-ae0e-7bca09d85723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.398628 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b073fb-616a-4186-948d-a96590d13b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.400562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b073fb-616a-4186-948d-a96590d13b8e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.416022 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-c2cbabe9-f2d9-46a5-ae0e-7bca09d85723 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.417526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c2cbabe9-f2d9-46a5-ae0e-7bca09d85723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.426358 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 775/1554] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.427734 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f97d1-8881-4ba3-8700-d29b1c749b93 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.428024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f97d1-8881-4ba3-8700-d29b1c749b93 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.428302 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f97d1-8881-4ba3-8700-d29b1c749b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.434848 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 780/1555] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:55.435652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b073fb-616a-4186-948d-a96590d13b8e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.447309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-724f97d1-8881-4ba3-8700-d29b1c749b93 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.448476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-724f97d1-8881-4ba3-8700-d29b1c749b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.501883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b073fb-616a-4186-948d-a96590d13b8e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.513538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 776/1556] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.513762 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82ad8e-bd53-461a-8104-bc9d27d80cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.513883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1724392-9b0d-41c9-b5ad-cfca9f49aca9 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.513883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1724392-9b0d-41c9-b5ad-cfca9f49aca9 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.513883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1724392-9b0d-41c9-b5ad-cfca9f49aca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.514093 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82ad8e-bd53-461a-8104-bc9d27d80cad admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.514093 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82ad8e-bd53-461a-8104-bc9d27d80cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.514093 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82ad8e-bd53-461a-8104-bc9d27d80cad admin admin] PATH_INFO: `/v3/projects/4c019a195f44431686f7ab8266e87ff2/users/0c131301aa22491f8b1feb32d006ea62/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.526540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82ad8e-bd53-461a-8104-bc9d27d80cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c019a195f44431686f7ab8266e87ff2, user_id=0c131301aa22491f8b1feb32d006ea62, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.526832 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e1724392-9b0d-41c9-b5ad-cfca9f49aca9 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.528010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e1724392-9b0d-41c9-b5ad-cfca9f49aca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.529205 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82ad8e-bd53-461a-8104-bc9d27d80cad admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.537858 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 777/1557] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.543473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 781/1558] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:55 2022] PUT /identity/v3/projects/4c019a195f44431686f7ab8266e87ff2/users/0c131301aa22491f8b1feb32d006ea62/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:55.543614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acec9a-a909-43c1-8a2b-5cc48025b3d6 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.543875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acec9a-a909-43c1-8a2b-5cc48025b3d6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.544150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acec9a-a909-43c1-8a2b-5cc48025b3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.544257 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82ad8e-bd53-461a-8104-bc9d27d80cad admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.562539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-44acec9a-a909-43c1-8a2b-5cc48025b3d6 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.563711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-44acec9a-a909-43c1-8a2b-5cc48025b3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.601988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82ad8e-bd53-461a-8104-bc9d27d80cad admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.606557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2645f-8956-4693-9dcb-aac7ee39a698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.607203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2645f-8956-4693-9dcb-aac7ee39a698 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.607480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2645f-8956-4693-9dcb-aac7ee39a698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.607752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2645f-8956-4693-9dcb-aac7ee39a698 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.608462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2645f-8956-4693-9dcb-aac7ee39a698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:55.608764 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2645f-8956-4693-9dcb-aac7ee39a698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.610380 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2645f-8956-4693-9dcb-aac7ee39a698 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.619939 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 778/1559] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.627354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc79c38-cd9e-4be8-ae68-6eb526a42e31 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.627354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc79c38-cd9e-4be8-ae68-6eb526a42e31 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.627354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc79c38-cd9e-4be8-ae68-6eb526a42e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.627676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 782/1560] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:55.627676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f60ed-df1c-4b8b-a6ab-55eb95bef699 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.627676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f60ed-df1c-4b8b-a6ab-55eb95bef699 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.627676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f60ed-df1c-4b8b-a6ab-55eb95bef699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.645036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-9fc79c38-cd9e-4be8-ae68-6eb526a42e31 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.645444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a39f60ed-df1c-4b8b-a6ab-55eb95bef699 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.646230 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9fc79c38-cd9e-4be8-ae68-6eb526a42e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.646680 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a39f60ed-df1c-4b8b-a6ab-55eb95bef699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.653963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 779/1561] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.654651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 783/1562] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.655869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83336a28-faf1-4e42-bbec-50668415f1ea None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.656150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83336a28-faf1-4e42-bbec-50668415f1ea None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.656420 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83336a28-faf1-4e42-bbec-50668415f1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.662068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc79c38-cd9e-4be8-ae68-6eb526a42e31 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.671229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc79c38-cd9e-4be8-ae68-6eb526a42e31 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.675055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-83336a28-faf1-4e42-bbec-50668415f1ea None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.675779 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f12662-6324-47b7-922a-a59dde6a8f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.676224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-83336a28-faf1-4e42-bbec-50668415f1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.676429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f12662-6324-47b7-922a-a59dde6a8f21 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.676709 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f12662-6324-47b7-922a-a59dde6a8f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.676983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f12662-6324-47b7-922a-a59dde6a8f21 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.677665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f12662-6324-47b7-922a-a59dde6a8f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.679635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f12662-6324-47b7-922a-a59dde6a8f21 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.685498 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 784/1563] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.686334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83336a28-faf1-4e42-bbec-50668415f1ea None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.698910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83336a28-faf1-4e42-bbec-50668415f1ea None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.703152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 780/1564] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:55.703152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15c87d-20d3-4f28-9b3f-8f7a561148c3 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.703152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15c87d-20d3-4f28-9b3f-8f7a561148c3 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.703152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15c87d-20d3-4f28-9b3f-8f7a561148c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.706808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0d2e6-3978-4f5c-905b-75a6285dd692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.707450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0d2e6-3978-4f5c-905b-75a6285dd692 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.707728 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0d2e6-3978-4f5c-905b-75a6285dd692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.707998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0d2e6-3978-4f5c-905b-75a6285dd692 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.708712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0d2e6-3978-4f5c-905b-75a6285dd692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:55.709016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0d2e6-3978-4f5c-905b-75a6285dd692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.710688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0d2e6-3978-4f5c-905b-75a6285dd692 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.722734 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-8c15c87d-20d3-4f28-9b3f-8f7a561148c3 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.724251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 785/1565] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:55.725050 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8c15c87d-20d3-4f28-9b3f-8f7a561148c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.725607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b756464-2038-4df6-a6ae-da3df09b8b32 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.725896 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b756464-2038-4df6-a6ae-da3df09b8b32 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.726168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b756464-2038-4df6-a6ae-da3df09b8b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.736099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 781/1566] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.736989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15c87d-20d3-4f28-9b3f-8f7a561148c3 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.746011 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-5b756464-2038-4df6-a6ae-da3df09b8b32 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.746869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15c87d-20d3-4f28-9b3f-8f7a561148c3 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.747527 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5b756464-2038-4df6-a6ae-da3df09b8b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.751430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981948d5-41d3-4389-a875-7b16515dfe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.752078 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981948d5-41d3-4389-a875-7b16515dfe29 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.752359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981948d5-41d3-4389-a875-7b16515dfe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.752630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981948d5-41d3-4389-a875-7b16515dfe29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.753317 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981948d5-41d3-4389-a875-7b16515dfe29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.755367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 786/1567] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.755496 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981948d5-41d3-4389-a875-7b16515dfe29 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.755947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b756464-2038-4df6-a6ae-da3df09b8b32 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.765200 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b756464-2038-4df6-a6ae-da3df09b8b32 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.769777 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e13321-51d8-4f31-a213-2e447fa00326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.770489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e13321-51d8-4f31-a213-2e447fa00326 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.770757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e13321-51d8-4f31-a213-2e447fa00326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.771031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e13321-51d8-4f31-a213-2e447fa00326 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.772126 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e13321-51d8-4f31-a213-2e447fa00326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:55.772433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e13321-51d8-4f31-a213-2e447fa00326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.774856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e13321-51d8-4f31-a213-2e447fa00326 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.781673 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 782/1568] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:55.783088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f497e-ac69-43ad-bda9-b2beee2cde08 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.783658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f497e-ac69-43ad-bda9-b2beee2cde08 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.783658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f497e-ac69-43ad-bda9-b2beee2cde08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.787085 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 787/1569] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:55.787893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e13321-51d8-4f31-a213-2e447fa00326 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.802854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e13321-51d8-4f31-a213-2e447fa00326 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.807816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-c52f497e-ac69-43ad-bda9-b2beee2cde08 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:55.808979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c52f497e-ac69-43ad-bda9-b2beee2cde08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:55.858162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f36fc3-1ab3-48e7-adb1-cf121d95d5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.858854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f36fc3-1ab3-48e7-adb1-cf121d95d5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.859146 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f36fc3-1ab3-48e7-adb1-cf121d95d5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.859416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f36fc3-1ab3-48e7-adb1-cf121d95d5d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.860180 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f36fc3-1ab3-48e7-adb1-cf121d95d5d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:55.860531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f36fc3-1ab3-48e7-adb1-cf121d95d5d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.862159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f36fc3-1ab3-48e7-adb1-cf121d95d5d0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.864842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 783/1570] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:55.865667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f497e-ac69-43ad-bda9-b2beee2cde08 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.873873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 788/1571] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:55.874835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f497e-ac69-43ad-bda9-b2beee2cde08 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.878391 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f36fc3-1ab3-48e7-adb1-cf121d95d5d0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.879397 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c8f46-60cc-40fd-95ce-6386e3f8657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.880053 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c8f46-60cc-40fd-95ce-6386e3f8657c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.880335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c8f46-60cc-40fd-95ce-6386e3f8657c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.880607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c8f46-60cc-40fd-95ce-6386e3f8657c admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.881332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c8f46-60cc-40fd-95ce-6386e3f8657c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.882975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c8f46-60cc-40fd-95ce-6386e3f8657c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.888371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f36fc3-1ab3-48e7-adb1-cf121d95d5d0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.895616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 784/1572] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:55.895773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb50e1-1c74-44a1-a879-03e07d906eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.895896 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c8f46-60cc-40fd-95ce-6386e3f8657c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.895987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb50e1-1c74-44a1-a879-03e07d906eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.895987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb50e1-1c74-44a1-a879-03e07d906eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.895987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb50e1-1c74-44a1-a879-03e07d906eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.895987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb50e1-1c74-44a1-a879-03e07d906eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.897546 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb50e1-1c74-44a1-a879-03e07d906eb5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.924095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 789/1573] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:55 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:55.924905 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb50e1-1c74-44a1-a879-03e07d906eb5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:55.949221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c8f46-60cc-40fd-95ce-6386e3f8657c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.982367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb50e1-1c74-44a1-a879-03e07d906eb5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:55.986918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498b66f-45a4-4d72-a569-fdbf6bd91d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.987569 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498b66f-45a4-4d72-a569-fdbf6bd91d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.987848 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498b66f-45a4-4d72-a569-fdbf6bd91d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.988120 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498b66f-45a4-4d72-a569-fdbf6bd91d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:55.988829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498b66f-45a4-4d72-a569-fdbf6bd91d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:55.989130 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498b66f-45a4-4d72-a569-fdbf6bd91d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:55.990747 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498b66f-45a4-4d72-a569-fdbf6bd91d38 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:55.995693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101460a7-a978-436c-a36a-1fbaca6b8227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:55.996362 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101460a7-a978-436c-a36a-1fbaca6b8227 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:55.996636 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101460a7-a978-436c-a36a-1fbaca6b8227 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:55.996909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101460a7-a978-436c-a36a-1fbaca6b8227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.009953 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 790/1574] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:56.009953 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498b66f-45a4-4d72-a569-fdbf6bd91d38 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.010258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101460a7-a978-436c-a36a-1fbaca6b8227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.010258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101460a7-a978-436c-a36a-1fbaca6b8227 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.012835 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498b66f-45a4-4d72-a569-fdbf6bd91d38 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.017287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 785/1575] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:56.017401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14d956-81e0-458e-8871-2006585e5312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.017924 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101460a7-a978-436c-a36a-1fbaca6b8227 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.018080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14d956-81e0-458e-8871-2006585e5312 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.018505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14d956-81e0-458e-8871-2006585e5312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.018883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14d956-81e0-458e-8871-2006585e5312 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.019564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14d956-81e0-458e-8871-2006585e5312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.021474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14d956-81e0-458e-8871-2006585e5312 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.027517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101460a7-a978-436c-a36a-1fbaca6b8227 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.032825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f0694-d703-4534-85ef-3f6974ff70c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.033851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f0694-d703-4534-85ef-3f6974ff70c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.033993 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f0694-d703-4534-85ef-3f6974ff70c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.034192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f0694-d703-4534-85ef-3f6974ff70c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.034948 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f0694-d703-4534-85ef-3f6974ff70c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.038052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f0694-d703-4534-85ef-3f6974ff70c2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.047442 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 791/1576] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:56 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:56.047442 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14d956-81e0-458e-8871-2006585e5312 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.056408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14d956-81e0-458e-8871-2006585e5312 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.062119 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8784de-a550-4f11-afd6-585c96237272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.062922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8784de-a550-4f11-afd6-585c96237272 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.063301 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8784de-a550-4f11-afd6-585c96237272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.063679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8784de-a550-4f11-afd6-585c96237272 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.064410 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8784de-a550-4f11-afd6-585c96237272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:56.064718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8784de-a550-4f11-afd6-585c96237272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.068896 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 786/1577] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:56 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:56.069033 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8784de-a550-4f11-afd6-585c96237272 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.069134 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f0694-d703-4534-85ef-3f6974ff70c2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.080699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 792/1578] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:56.081578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8784de-a550-4f11-afd6-585c96237272 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.097952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8784de-a550-4f11-afd6-585c96237272 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.143951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f0694-d703-4534-85ef-3f6974ff70c2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.149630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f443ada-49f0-4706-8f25-2367b3b87629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.150435 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443ada-49f0-4706-8f25-2367b3b87629 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.150746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443ada-49f0-4706-8f25-2367b3b87629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.151101 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443ada-49f0-4706-8f25-2367b3b87629 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.151989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f443ada-49f0-4706-8f25-2367b3b87629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.153641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f443ada-49f0-4706-8f25-2367b3b87629 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.165726 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac652-e626-4531-b65e-5a96443951a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.166422 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac652-e626-4531-b65e-5a96443951a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.166705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac652-e626-4531-b65e-5a96443951a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.167051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac652-e626-4531-b65e-5a96443951a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.167700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ac652-e626-4531-b65e-5a96443951a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.169348 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ac652-e626-4531-b65e-5a96443951a1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.181421 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 793/1579] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:56.182455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac652-e626-4531-b65e-5a96443951a1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.191489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 787/1580] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:56 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:56.191489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f443ada-49f0-4706-8f25-2367b3b87629 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.194068 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac652-e626-4531-b65e-5a96443951a1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.263502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5111247-f3d1-474e-a899-47400fa0fa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.264174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5111247-f3d1-474e-a899-47400fa0fa83 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.264454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5111247-f3d1-474e-a899-47400fa0fa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.264737 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5111247-f3d1-474e-a899-47400fa0fa83 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.265454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5111247-f3d1-474e-a899-47400fa0fa83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.267537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5111247-f3d1-474e-a899-47400fa0fa83 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.272411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f443ada-49f0-4706-8f25-2367b3b87629 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.278950 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe3375-9350-41ac-b235-e549d9129353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.279867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe3375-9350-41ac-b235-e549d9129353 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.280221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe3375-9350-41ac-b235-e549d9129353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.280565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe3375-9350-41ac-b235-e549d9129353 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.281990 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe3375-9350-41ac-b235-e549d9129353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.283849 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe3375-9350-41ac-b235-e549d9129353 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.292462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 794/1581] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:56 2022] POST /identity/v3/users => generated 303 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:56.293558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5111247-f3d1-474e-a899-47400fa0fa83 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.304605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5111247-f3d1-474e-a899-47400fa0fa83 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.311151 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5357f-1521-4d43-bfbb-be3136ca274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.312062 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5357f-1521-4d43-bfbb-be3136ca274f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.312347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5357f-1521-4d43-bfbb-be3136ca274f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.312688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5357f-1521-4d43-bfbb-be3136ca274f admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.313414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5357f-1521-4d43-bfbb-be3136ca274f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.315051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5357f-1521-4d43-bfbb-be3136ca274f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.319635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 788/1582] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:56 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:56.324139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe3375-9350-41ac-b235-e549d9129353 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.328870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 795/1583] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:56.328870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5357f-1521-4d43-bfbb-be3136ca274f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.339432 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5357f-1521-4d43-bfbb-be3136ca274f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.401467 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caba4d-967f-49fe-98b6-81ded65a787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.402278 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caba4d-967f-49fe-98b6-81ded65a787d admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.402754 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caba4d-967f-49fe-98b6-81ded65a787d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.402902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caba4d-967f-49fe-98b6-81ded65a787d admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.403223 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe3375-9350-41ac-b235-e549d9129353 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.403652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80caba4d-967f-49fe-98b6-81ded65a787d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.405666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80caba4d-967f-49fe-98b6-81ded65a787d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.418966 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a23765-7632-4d84-bc48-e9be466b1749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.419711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a23765-7632-4d84-bc48-e9be466b1749 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.420004 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a23765-7632-4d84-bc48-e9be466b1749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.420268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a23765-7632-4d84-bc48-e9be466b1749 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.421566 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a23765-7632-4d84-bc48-e9be466b1749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.423666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a23765-7632-4d84-bc48-e9be466b1749 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.441117 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 796/1584] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:56 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:56.441117 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caba4d-967f-49fe-98b6-81ded65a787d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.457331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 789/1585] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:56 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:56.457331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a23765-7632-4d84-bc48-e9be466b1749 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.467684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a23765-7632-4d84-bc48-e9be466b1749 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.512004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caba4d-967f-49fe-98b6-81ded65a787d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.517411 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92009db9-ec44-4203-8161-c53a5b4dcd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.518468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92009db9-ec44-4203-8161-c53a5b4dcd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.518852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92009db9-ec44-4203-8161-c53a5b4dcd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.519194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92009db9-ec44-4203-8161-c53a5b4dcd14 admin admin] PATH_INFO: `/v3/projects/571cfccc6cac4ab88b761ee6f28a0b26/users/2e6db154a549420aa58b14ef9c4c5f31/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.534685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92009db9-ec44-4203-8161-c53a5b4dcd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=571cfccc6cac4ab88b761ee6f28a0b26, user_id=2e6db154a549420aa58b14ef9c4c5f31, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.537474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92009db9-ec44-4203-8161-c53a5b4dcd14 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.539342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff872b-cbfd-4d18-a61c-2f3983364a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.540676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff872b-cbfd-4d18-a61c-2f3983364a72 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.541032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff872b-cbfd-4d18-a61c-2f3983364a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.541447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff872b-cbfd-4d18-a61c-2f3983364a72 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.542137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff872b-cbfd-4d18-a61c-2f3983364a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.544808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff872b-cbfd-4d18-a61c-2f3983364a72 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.552711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 797/1586] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:56 2022] PUT /identity/v3/projects/571cfccc6cac4ab88b761ee6f28a0b26/users/2e6db154a549420aa58b14ef9c4c5f31/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:56.553868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92009db9-ec44-4203-8161-c53a5b4dcd14 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.578523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 790/1587] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:56 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:56.579587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff872b-cbfd-4d18-a61c-2f3983364a72 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.590379 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff872b-cbfd-4d18-a61c-2f3983364a72 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.624290 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92009db9-ec44-4203-8161-c53a5b4dcd14 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.629252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454df6e-427e-4536-bda6-e905ffcb0975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.629923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454df6e-427e-4536-bda6-e905ffcb0975 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.630229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454df6e-427e-4536-bda6-e905ffcb0975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.630516 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454df6e-427e-4536-bda6-e905ffcb0975 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.631512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454df6e-427e-4536-bda6-e905ffcb0975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.632950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454df6e-427e-4536-bda6-e905ffcb0975 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.644377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 798/1588] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:56.645352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454df6e-427e-4536-bda6-e905ffcb0975 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.652972 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc894760-a5ac-4c2f-8d96-c1799bf9eef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.653657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc894760-a5ac-4c2f-8d96-c1799bf9eef7 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.654166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc894760-a5ac-4c2f-8d96-c1799bf9eef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.654384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc894760-a5ac-4c2f-8d96-c1799bf9eef7 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.655084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc894760-a5ac-4c2f-8d96-c1799bf9eef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.657020 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc894760-a5ac-4c2f-8d96-c1799bf9eef7 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.658564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454df6e-427e-4536-bda6-e905ffcb0975 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.664312 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dcb1d-ed47-4a47-966a-05a76c3f36c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.665966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dcb1d-ed47-4a47-966a-05a76c3f36c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.665966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dcb1d-ed47-4a47-966a-05a76c3f36c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.666181 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dcb1d-ed47-4a47-966a-05a76c3f36c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.666887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dcb1d-ed47-4a47-966a-05a76c3f36c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.668580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dcb1d-ed47-4a47-966a-05a76c3f36c6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.679646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 799/1589] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:56.680647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dcb1d-ed47-4a47-966a-05a76c3f36c6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.681260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 791/1590] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:56 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:56.682630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc894760-a5ac-4c2f-8d96-c1799bf9eef7 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.694327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc894760-a5ac-4c2f-8d96-c1799bf9eef7 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.694521 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dcb1d-ed47-4a47-966a-05a76c3f36c6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.700298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a6c90-bc76-46fc-8af8-31337ca5f849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.701007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a6c90-bc76-46fc-8af8-31337ca5f849 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.701179 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa8f31-0723-443f-a809-091e219c75d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.701295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a6c90-bc76-46fc-8af8-31337ca5f849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.701594 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a6c90-bc76-46fc-8af8-31337ca5f849 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.701942 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa8f31-0723-443f-a809-091e219c75d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.702252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa8f31-0723-443f-a809-091e219c75d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.702372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a6c90-bc76-46fc-8af8-31337ca5f849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.702682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa8f31-0723-443f-a809-091e219c75d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.703460 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa8f31-0723-443f-a809-091e219c75d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.704276 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a6c90-bc76-46fc-8af8-31337ca5f849 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.705013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa8f31-0723-443f-a809-091e219c75d4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.717916 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 792/1591] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:56.722564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c5a6-aac9-4df1-8a3a-63c861d297a8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.722564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c5a6-aac9-4df1-8a3a-63c861d297a8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.722564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c5a6-aac9-4df1-8a3a-63c861d297a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.732168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 800/1592] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:56 2022] POST /identity/v3/users => generated 287 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:56.733065 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a6c90-bc76-46fc-8af8-31337ca5f849 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.747062 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a6c90-bc76-46fc-8af8-31337ca5f849 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.751913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab12ef-c7fb-4659-8025-ef7264262fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.752540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab12ef-c7fb-4659-8025-ef7264262fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.752822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab12ef-c7fb-4659-8025-ef7264262fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.753261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab12ef-c7fb-4659-8025-ef7264262fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.753991 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab12ef-c7fb-4659-8025-ef7264262fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.755773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab12ef-c7fb-4659-8025-ef7264262fd1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.765584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-9633c5a6-aac9-4df1-8a3a-63c861d297a8 None None] MFA Rules not processed for user `2e6db154a549420aa58b14ef9c4c5f31`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:56.767004 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9633c5a6-aac9-4df1-8a3a-63c861d297a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:56.768302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 801/1593] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:56.769143 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab12ef-c7fb-4659-8025-ef7264262fd1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.779702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab12ef-c7fb-4659-8025-ef7264262fd1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.786330 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9660257-da44-41bb-ae90-0b47d2878dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.787221 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9660257-da44-41bb-ae90-0b47d2878dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.787647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9660257-da44-41bb-ae90-0b47d2878dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.787933 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9660257-da44-41bb-ae90-0b47d2878dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.788660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9660257-da44-41bb-ae90-0b47d2878dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.790540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9660257-da44-41bb-ae90-0b47d2878dd7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.805805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 802/1594] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:56.805805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9660257-da44-41bb-ae90-0b47d2878dd7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.814918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9660257-da44-41bb-ae90-0b47d2878dd7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.820150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d37f9-4fe7-4f6e-9458-ce1ed554b268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.821583 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d37f9-4fe7-4f6e-9458-ce1ed554b268 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.821863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d37f9-4fe7-4f6e-9458-ce1ed554b268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.822443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d37f9-4fe7-4f6e-9458-ce1ed554b268 admin admin] PATH_INFO: `/v3/projects/1d4fde563e8d4358b1f8d7c778e7dc59/users/faac09d2bacd4759ada261c83b83362e/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.837828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d37f9-4fe7-4f6e-9458-ce1ed554b268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4fde563e8d4358b1f8d7c778e7dc59, user_id=faac09d2bacd4759ada261c83b83362e, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.840954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d37f9-4fe7-4f6e-9458-ce1ed554b268 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.854430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 793/1595] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:56.854430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633c5a6-aac9-4df1-8a3a-63c861d297a8 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.866933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633c5a6-aac9-4df1-8a3a-63c861d297a8 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.873100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 803/1596] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:56 2022] PUT /identity/v3/projects/1d4fde563e8d4358b1f8d7c778e7dc59/users/faac09d2bacd4759ada261c83b83362e/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:56.874431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d37f9-4fe7-4f6e-9458-ce1ed554b268 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.929003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc11484-6b2f-4830-9617-7922c70832a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.929685 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc11484-6b2f-4830-9617-7922c70832a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.929968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc11484-6b2f-4830-9617-7922c70832a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.930284 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc11484-6b2f-4830-9617-7922c70832a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.931025 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc11484-6b2f-4830-9617-7922c70832a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.933268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc11484-6b2f-4830-9617-7922c70832a7 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.949147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 794/1597] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:56.951625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc11484-6b2f-4830-9617-7922c70832a7 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.953821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d37f9-4fe7-4f6e-9458-ce1ed554b268 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.960726 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114fcf3-efc2-481b-a6b7-a626ce782c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.961530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114fcf3-efc2-481b-a6b7-a626ce782c75 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.962433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114fcf3-efc2-481b-a6b7-a626ce782c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.962988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114fcf3-efc2-481b-a6b7-a626ce782c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.963781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114fcf3-efc2-481b-a6b7-a626ce782c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.965467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc11484-6b2f-4830-9617-7922c70832a7 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.965607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114fcf3-efc2-481b-a6b7-a626ce782c75 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.971300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701f5fd-f089-4a40-a59c-7583ade90b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:56.973167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701f5fd-f089-4a40-a59c-7583ade90b43 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:56.973744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701f5fd-f089-4a40-a59c-7583ade90b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:56.974028 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701f5fd-f089-4a40-a59c-7583ade90b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:56.974804 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701f5fd-f089-4a40-a59c-7583ade90b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:56.976487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701f5fd-f089-4a40-a59c-7583ade90b43 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:56.976809 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 804/1598] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:56.977739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114fcf3-efc2-481b-a6b7-a626ce782c75 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:56.990808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114fcf3-efc2-481b-a6b7-a626ce782c75 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:56.991581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 795/1599] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:56.992497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701f5fd-f089-4a40-a59c-7583ade90b43 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:57.004631 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127714b-69bf-4906-b3e9-aec492c3c86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.005319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127714b-69bf-4906-b3e9-aec492c3c86c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.005605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127714b-69bf-4906-b3e9-aec492c3c86c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.005870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127714b-69bf-4906-b3e9-aec492c3c86c admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.007160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127714b-69bf-4906-b3e9-aec492c3c86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.009340 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127714b-69bf-4906-b3e9-aec492c3c86c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.010147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701f5fd-f089-4a40-a59c-7583ade90b43 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:57.015699 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01330b52-1c24-4b0a-9961-0c9487df5020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.016981 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330b52-1c24-4b0a-9961-0c9487df5020 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.017510 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330b52-1c24-4b0a-9961-0c9487df5020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.018096 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330b52-1c24-4b0a-9961-0c9487df5020 admin admin] PATH_INFO: `/v3/projects/9067bad03c0f423c82aa89ddf9dcfd5d/users/ed2adcaaec4642d3a275317109798486/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.022989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 805/1600] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:57.023844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127714b-69bf-4906-b3e9-aec492c3c86c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:57.037918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127714b-69bf-4906-b3e9-aec492c3c86c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:57.042496 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01330b52-1c24-4b0a-9961-0c9487df5020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9067bad03c0f423c82aa89ddf9dcfd5d, user_id=ed2adcaaec4642d3a275317109798486, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.043978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcecb8-9d6a-468c-bea3-588c39944f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.045670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01330b52-1c24-4b0a-9961-0c9487df5020 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.046791 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcecb8-9d6a-468c-bea3-588c39944f92 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.047103 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcecb8-9d6a-468c-bea3-588c39944f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.047382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcecb8-9d6a-468c-bea3-588c39944f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.048091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcecb8-9d6a-468c-bea3-588c39944f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.050520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcecb8-9d6a-468c-bea3-588c39944f92 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.070334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 796/1601] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:56 2022] PUT /identity/v3/projects/9067bad03c0f423c82aa89ddf9dcfd5d/users/ed2adcaaec4642d3a275317109798486/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:57.070334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd8673-e2a4-4692-a58b-ab159d2f6f12 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.070334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd8673-e2a4-4692-a58b-ab159d2f6f12 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.070334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd8673-e2a4-4692-a58b-ab159d2f6f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.087541 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 806/1602] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:57 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:57.089686 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcecb8-9d6a-468c-bea3-588c39944f92 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:57.090053 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f3bd8673-e2a4-4692-a58b-ab159d2f6f12 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:57.091494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f3bd8673-e2a4-4692-a58b-ab159d2f6f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:57.167053 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 797/1603] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:57.168034 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd8673-e2a4-4692-a58b-ab159d2f6f12 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:57.173711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcecb8-9d6a-468c-bea3-588c39944f92 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:57.180036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd8673-e2a4-4692-a58b-ab159d2f6f12 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:57.186710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeae09-f845-4548-be87-fc3886357fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.187022 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8c660-25c4-4d68-b05b-9b229e2803b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.187405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeae09-f845-4548-be87-fc3886357fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.187689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeae09-f845-4548-be87-fc3886357fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.187965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeae09-f845-4548-be87-fc3886357fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.188704 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddeae09-f845-4548-be87-fc3886357fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.189060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c660-25c4-4d68-b05b-9b229e2803b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.190348 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddeae09-f845-4548-be87-fc3886357fc9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.190733 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c660-25c4-4d68-b05b-9b229e2803b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.191290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c660-25c4-4d68-b05b-9b229e2803b0 admin admin] PATH_INFO: `/v3/projects/4e728b09525741f1810074c72d2af8eb/users/215d92a8b22b456384c45dc281bea574/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.204084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 807/1604] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:57.204084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeae09-f845-4548-be87-fc3886357fc9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:57.213310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8c660-25c4-4d68-b05b-9b229e2803b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e728b09525741f1810074c72d2af8eb, user_id=215d92a8b22b456384c45dc281bea574, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.216036 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeae09-f845-4548-be87-fc3886357fc9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:57.218385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8c660-25c4-4d68-b05b-9b229e2803b0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.220844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ffcd5-1fb3-485c-926b-c93058ff2f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.221513 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ffcd5-1fb3-485c-926b-c93058ff2f10 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.221795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ffcd5-1fb3-485c-926b-c93058ff2f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.222071 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ffcd5-1fb3-485c-926b-c93058ff2f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.223032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ffcd5-1fb3-485c-926b-c93058ff2f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.225322 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ffcd5-1fb3-485c-926b-c93058ff2f10 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.238077 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 808/1605] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:57.239091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ffcd5-1fb3-485c-926b-c93058ff2f10 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:57.240153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 798/1606] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:57 2022] PUT /identity/v3/projects/4e728b09525741f1810074c72d2af8eb/users/215d92a8b22b456384c45dc281bea574/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:57.241765 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8a07d-085e-46c0-9b47-8de81dfc5c6e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.242281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8a07d-085e-46c0-9b47-8de81dfc5c6e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.242935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8a07d-085e-46c0-9b47-8de81dfc5c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.251694 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ffcd5-1fb3-485c-926b-c93058ff2f10 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:57.290406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-5ee8a07d-085e-46c0-9b47-8de81dfc5c6e None None] MFA Rules not processed for user `ed2adcaaec4642d3a275317109798486`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:57.291735 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5ee8a07d-085e-46c0-9b47-8de81dfc5c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:57.336013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b98932-2134-47e8-8402-4a3c80200851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.338701 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b98932-2134-47e8-8402-4a3c80200851 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.339198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b98932-2134-47e8-8402-4a3c80200851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.339661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b98932-2134-47e8-8402-4a3c80200851 admin admin] PATH_INFO: `/v3/projects/4f5d9729c5f34168b47c9e85ad329caa/users/e1ddbbbfd9c340c8b40715c103c8fef7/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.356586 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b98932-2134-47e8-8402-4a3c80200851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5d9729c5f34168b47c9e85ad329caa, user_id=e1ddbbbfd9c340c8b40715c103c8fef7, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.360077 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b98932-2134-47e8-8402-4a3c80200851 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.379958 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 809/1607] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:57 2022] PUT /identity/v3/projects/4f5d9729c5f34168b47c9e85ad329caa/users/e1ddbbbfd9c340c8b40715c103c8fef7/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:57.380872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b98932-2134-47e8-8402-4a3c80200851 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:57.386339 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 799/1608] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:57.387233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8a07d-085e-46c0-9b47-8de81dfc5c6e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:57.388585 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5ee8a07d-085e-46c0-9b47-8de81dfc5c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:57.465085 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b98932-2134-47e8-8402-4a3c80200851 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:57.469862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8a07d-085e-46c0-9b47-8de81dfc5c6e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:57.470476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3be4d7-5563-4d06-b0f9-c15e1cc1346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.471193 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be4d7-5563-4d06-b0f9-c15e1cc1346e admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.471547 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be4d7-5563-4d06-b0f9-c15e1cc1346e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.471904 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be4d7-5563-4d06-b0f9-c15e1cc1346e admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.472598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3be4d7-5563-4d06-b0f9-c15e1cc1346e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.474577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3be4d7-5563-4d06-b0f9-c15e1cc1346e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.505573 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 810/1609] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:57 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:57.507315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3be4d7-5563-4d06-b0f9-c15e1cc1346e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:57.527333 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3be4d7-5563-4d06-b0f9-c15e1cc1346e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:57.532253 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc746fb-5f1d-456a-a0b7-f6f3555e51c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.533018 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc746fb-5f1d-456a-a0b7-f6f3555e51c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.533382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc746fb-5f1d-456a-a0b7-f6f3555e51c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.533734 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc746fb-5f1d-456a-a0b7-f6f3555e51c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.534496 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8581c3-a399-469d-b349-a6217e172dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.535764 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8581c3-a399-469d-b349-a6217e172dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.536449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8581c3-a399-469d-b349-a6217e172dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.537049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8581c3-a399-469d-b349-a6217e172dc9 admin admin] PATH_INFO: `/v3/projects/dc95cdaceac64f92ac8ca5b296ce7e33/users/043b79a846ed41a6a446a1c533068af9/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.548372 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc746fb-5f1d-456a-a0b7-f6f3555e51c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.550233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc746fb-5f1d-456a-a0b7-f6f3555e51c7 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.561099 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8581c3-a399-469d-b349-a6217e172dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc95cdaceac64f92ac8ca5b296ce7e33, user_id=043b79a846ed41a6a446a1c533068af9, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.564570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8581c3-a399-469d-b349-a6217e172dc9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.569121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 800/1610] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:57.570763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc746fb-5f1d-456a-a0b7-f6f3555e51c7 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:57.581947 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc746fb-5f1d-456a-a0b7-f6f3555e51c7 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:57.587567 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01997b94-f729-4bb9-9709-4f7b1cfa5be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.588518 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01997b94-f729-4bb9-9709-4f7b1cfa5be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.588808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01997b94-f729-4bb9-9709-4f7b1cfa5be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.589229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01997b94-f729-4bb9-9709-4f7b1cfa5be4 admin admin] PATH_INFO: `/v3/projects/5a4573668eef49469fbca151c489dd3c/users/f52ee19cc9174fc39162cf79e68b487e/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.606591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 811/1611] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:57 2022] PUT /identity/v3/projects/dc95cdaceac64f92ac8ca5b296ce7e33/users/043b79a846ed41a6a446a1c533068af9/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:57.607965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01997b94-f729-4bb9-9709-4f7b1cfa5be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4573668eef49469fbca151c489dd3c, user_id=f52ee19cc9174fc39162cf79e68b487e, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.608596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29aa66-e329-45a0-a677-086fd1bf3545 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.608964 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29aa66-e329-45a0-a677-086fd1bf3545 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.609313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29aa66-e329-45a0-a677-086fd1bf3545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.611032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01997b94-f729-4bb9-9709-4f7b1cfa5be4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.640362 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 801/1612] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:57 2022] PUT /identity/v3/projects/5a4573668eef49469fbca151c489dd3c/users/f52ee19cc9174fc39162cf79e68b487e/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:57.641440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01997b94-f729-4bb9-9709-4f7b1cfa5be4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:57.657015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-9c29aa66-e329-45a0-a677-086fd1bf3545 None None] MFA Rules not processed for user `215d92a8b22b456384c45dc281bea574`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:57.658839 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9c29aa66-e329-45a0-a677-086fd1bf3545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:57.772384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01997b94-f729-4bb9-9709-4f7b1cfa5be4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:57.778911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb680a-2312-4302-932d-0b570733a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.779623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb680a-2312-4302-932d-0b570733a4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.779989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb680a-2312-4302-932d-0b570733a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.780178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb680a-2312-4302-932d-0b570733a4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.780990 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb680a-2312-4302-932d-0b570733a4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.783107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb680a-2312-4302-932d-0b570733a4a2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.795816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 812/1613] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:57.839563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c3243-ba78-4bb7-a3d3-a5524b2572a9 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.839563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c3243-ba78-4bb7-a3d3-a5524b2572a9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.839563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c3243-ba78-4bb7-a3d3-a5524b2572a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.842247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 802/1614] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:57 2022] POST /identity/v3/projects => generated 405 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:57.842247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb680a-2312-4302-932d-0b570733a4a2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:57.904738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-643c3243-ba78-4bb7-a3d3-a5524b2572a9 None None] MFA Rules not processed for user `e1ddbbbfd9c340c8b40715c103c8fef7`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:57.906406 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-643c3243-ba78-4bb7-a3d3-a5524b2572a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:57.935228 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb680a-2312-4302-932d-0b570733a4a2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:57.941308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e584488-a881-452a-9ccb-da3d2de415cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:57.942298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e584488-a881-452a-9ccb-da3d2de415cd admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.942595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e584488-a881-452a-9ccb-da3d2de415cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.942874 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e584488-a881-452a-9ccb-da3d2de415cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.943686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e584488-a881-452a-9ccb-da3d2de415cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:57.945314 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e584488-a881-452a-9ccb-da3d2de415cd admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:57.961790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 803/1615] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:57.965373 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac28bac-0410-40bc-bd71-065eb313d97e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.965674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac28bac-0410-40bc-bd71-065eb313d97e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.967721 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac28bac-0410-40bc-bd71-065eb313d97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:57.994333 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 813/1616] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:57.996209 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8284a8-7d12-454a-9d82-12529b865eef None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:57.996604 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8284a8-7d12-454a-9d82-12529b865eef None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:57.997185 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8284a8-7d12-454a-9d82-12529b865eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.024817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-bac28bac-0410-40bc-bd71-065eb313d97e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:58.027144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-bac28bac-0410-40bc-bd71-065eb313d97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:58.038029 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-bc8284a8-7d12-454a-9d82-12529b865eef None None] MFA Rules not processed for user `f52ee19cc9174fc39162cf79e68b487e`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:58.039808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-bc8284a8-7d12-454a-9d82-12529b865eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:58.045406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 804/1617] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:58.048791 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac28bac-0410-40bc-bd71-065eb313d97e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:58.059318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac28bac-0410-40bc-bd71-065eb313d97e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:58.064525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383c228-0a83-4236-b6bd-9736c8fd73d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:58.065351 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383c228-0a83-4236-b6bd-9736c8fd73d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.065639 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383c228-0a83-4236-b6bd-9736c8fd73d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.065912 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383c228-0a83-4236-b6bd-9736c8fd73d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.066631 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383c228-0a83-4236-b6bd-9736c8fd73d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:58.069137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383c228-0a83-4236-b6bd-9736c8fd73d4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:58.110265 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 805/1618] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:58 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:58.114175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383c228-0a83-4236-b6bd-9736c8fd73d4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:58.123789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 814/1619] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:58.125278 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8284a8-7d12-454a-9d82-12529b865eef None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:58.155881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8284a8-7d12-454a-9d82-12529b865eef None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:58.235449 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383c228-0a83-4236-b6bd-9736c8fd73d4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:58.249141 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c3100-e117-42a4-90b7-d015a69209f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:58.249743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c3100-e117-42a4-90b7-d015a69209f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.249981 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179ce6-2a5a-482b-86f7-b3ad59a855ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:58.250121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c3100-e117-42a4-90b7-d015a69209f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.250315 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c3100-e117-42a4-90b7-d015a69209f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.251307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179ce6-2a5a-482b-86f7-b3ad59a855ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.251425 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c3100-e117-42a4-90b7-d015a69209f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:58.251505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179ce6-2a5a-482b-86f7-b3ad59a855ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.251505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179ce6-2a5a-482b-86f7-b3ad59a855ec admin admin] PATH_INFO: `/v3/projects/4230e86ded534c42b85e8fda4e99a50e/users/5c61e25bf0044afb9634ca582c09e95e/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.258183 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c3100-e117-42a4-90b7-d015a69209f2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:58.269727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179ce6-2a5a-482b-86f7-b3ad59a855ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4230e86ded534c42b85e8fda4e99a50e, user_id=5c61e25bf0044afb9634ca582c09e95e, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:58.273503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179ce6-2a5a-482b-86f7-b3ad59a855ec admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:58.299779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 815/1620] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:58 2022] PUT /identity/v3/projects/4230e86ded534c42b85e8fda4e99a50e/users/5c61e25bf0044afb9634ca582c09e95e/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:58.299999 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 806/1621] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:58 2022] POST /identity/v3/users => generated 309 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:58.300436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c3100-e117-42a4-90b7-d015a69209f2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:58.301008 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af031d4c-e68e-46a0-8acd-1f715755cdbc None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.301304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af031d4c-e68e-46a0-8acd-1f715755cdbc None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.301585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af031d4c-e68e-46a0-8acd-1f715755cdbc None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.303752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 816/1622] 10.222.0.79 () {54 vars in 961 bytes} [Mon Feb 21 01:37:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:37:58.304463 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af031d4c-e68e-46a0-8acd-1f715755cdbc None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:58.377746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c3100-e117-42a4-90b7-d015a69209f2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:58.390689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af031d4c-e68e-46a0-8acd-1f715755cdbc None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:58.396428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b870b10-de68-440d-ae3c-4d44f1b8c4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:58.397212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870b10-de68-440d-ae3c-4d44f1b8c4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.397593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870b10-de68-440d-ae3c-4d44f1b8c4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.397948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870b10-de68-440d-ae3c-4d44f1b8c4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.398772 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b870b10-de68-440d-ae3c-4d44f1b8c4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:58.402658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b870b10-de68-440d-ae3c-4d44f1b8c4d9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:58.437729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04b62e-934a-4608-a2e5-51610d9af608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:58.438482 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04b62e-934a-4608-a2e5-51610d9af608 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.438794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04b62e-934a-4608-a2e5-51610d9af608 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.439235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04b62e-934a-4608-a2e5-51610d9af608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.443642 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 817/1623] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:58 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:58.448416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc81d16-0dd0-41de-b543-06473bf2d5cc None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.448725 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc81d16-0dd0-41de-b543-06473bf2d5cc None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.448978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc81d16-0dd0-41de-b543-06473bf2d5cc None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.449839 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04b62e-934a-4608-a2e5-51610d9af608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:58.450989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 818/1624] 10.222.0.79 () {54 vars in 961 bytes} [Mon Feb 21 01:37:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:37:58.451355 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04b62e-934a-4608-a2e5-51610d9af608 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:58.451543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc81d16-0dd0-41de-b543-06473bf2d5cc None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:58.463229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 807/1625] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:58.464250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04b62e-934a-4608-a2e5-51610d9af608 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:58.472222 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc81d16-0dd0-41de-b543-06473bf2d5cc None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:58.474790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04b62e-934a-4608-a2e5-51610d9af608 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:58.480402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a3539-6b57-4626-b373-bbadaada473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:58.481092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a3539-6b57-4626-b373-bbadaada473b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.481378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a3539-6b57-4626-b373-bbadaada473b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.481608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c08045-84c7-4ec7-b352-2f1030fdf7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:58.481745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a3539-6b57-4626-b373-bbadaada473b admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.482317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c08045-84c7-4ec7-b352-2f1030fdf7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.482402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a3539-6b57-4626-b373-bbadaada473b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:58.482592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c08045-84c7-4ec7-b352-2f1030fdf7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.484203 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a3539-6b57-4626-b373-bbadaada473b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:58.486120 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c08045-84c7-4ec7-b352-2f1030fdf7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.486978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c08045-84c7-4ec7-b352-2f1030fdf7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:58.488867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c08045-84c7-4ec7-b352-2f1030fdf7b7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:58.501037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 819/1626] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:58.504500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c10e8-8242-45c6-90e5-db6b02aa9135 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.504500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c10e8-8242-45c6-90e5-db6b02aa9135 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.504500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c10e8-8242-45c6-90e5-db6b02aa9135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.504826 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 808/1627] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:58.505861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a3539-6b57-4626-b373-bbadaada473b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:58.521793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a3539-6b57-4626-b373-bbadaada473b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:58.533666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987570d-f150-438b-b41b-a119831f25b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:58.534470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987570d-f150-438b-b41b-a119831f25b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.534715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987570d-f150-438b-b41b-a119831f25b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.535740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987570d-f150-438b-b41b-a119831f25b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.544242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987570d-f150-438b-b41b-a119831f25b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:58.547267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987570d-f150-438b-b41b-a119831f25b9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:58.548553 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b57c10e8-8242-45c6-90e5-db6b02aa9135 None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:58.550105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b57c10e8-8242-45c6-90e5-db6b02aa9135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:58.560934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 809/1628] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:58.562716 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd277b-7e94-42bf-ae22-b3873ded896c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.563225 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd277b-7e94-42bf-ae22-b3873ded896c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.563690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd277b-7e94-42bf-ae22-b3873ded896c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.584997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-bbbd277b-7e94-42bf-ae22-b3873ded896c None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:58.586870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-bbbd277b-7e94-42bf-ae22-b3873ded896c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:58.651351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 820/1629] 10.222.0.79 () {58 vars in 1058 bytes} [Mon Feb 21 01:37:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:58.655766 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c10e8-8242-45c6-90e5-db6b02aa9135 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:58.685359 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c10e8-8242-45c6-90e5-db6b02aa9135 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:58.706776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9958-42fa-42cc-8591-e3341c246989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:58.707913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9958-42fa-42cc-8591-e3341c246989 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.708311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 810/1630] 10.222.0.79 () {58 vars in 1058 bytes} [Mon Feb 21 01:37:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:58.709163 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd277b-7e94-42bf-ae22-b3873ded896c None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:58.710195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9958-42fa-42cc-8591-e3341c246989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.710504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9958-42fa-42cc-8591-e3341c246989 admin admin] PATH_INFO: `/v3/projects/c1fae5156a6f4d48879dbdb0afe0e3b6/users/9c34f0f16fbb4d1cb6fe6757d018e861/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.727321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd277b-7e94-42bf-ae22-b3873ded896c None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:58.732910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e564e5d-e7d5-41dd-8469-e85e66c8fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:58.734795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e564e5d-e7d5-41dd-8469-e85e66c8fb4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.735261 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e564e5d-e7d5-41dd-8469-e85e66c8fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.735710 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e564e5d-e7d5-41dd-8469-e85e66c8fb4b admin admin] PATH_INFO: `/v3/projects/4230e86ded534c42b85e8fda4e99a50e/users/5c61e25bf0044afb9634ca582c09e95e/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.738783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e564e5d-e7d5-41dd-8469-e85e66c8fb4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4230e86ded534c42b85e8fda4e99a50e, user_id=5c61e25bf0044afb9634ca582c09e95e, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:58.744080 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e564e5d-e7d5-41dd-8469-e85e66c8fb4b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:58.757478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 811/1631] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:58 2022] PUT /identity/v3/projects/4230e86ded534c42b85e8fda4e99a50e/users/5c61e25bf0044afb9634ca582c09e95e/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:58.759224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e564e5d-e7d5-41dd-8469-e85e66c8fb4b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:58.762038 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c9958-42fa-42cc-8591-e3341c246989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1fae5156a6f4d48879dbdb0afe0e3b6, user_id=9c34f0f16fbb4d1cb6fe6757d018e861, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:58.771920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c9958-42fa-42cc-8591-e3341c246989 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:58.800317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 821/1632] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:58 2022] PUT /identity/v3/projects/c1fae5156a6f4d48879dbdb0afe0e3b6/users/9c34f0f16fbb4d1cb6fe6757d018e861/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:58.803949 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9958-42fa-42cc-8591-e3341c246989 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:58.904854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e564e5d-e7d5-41dd-8469-e85e66c8fb4b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:58.959510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9958-42fa-42cc-8591-e3341c246989 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:58.969584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1163d7-79f7-48cc-9745-88a7a95d8af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:58.971909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1163d7-79f7-48cc-9745-88a7a95d8af1 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.972687 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1163d7-79f7-48cc-9745-88a7a95d8af1 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.973230 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1163d7-79f7-48cc-9745-88a7a95d8af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.978821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2dd31-ac68-4138-938a-ec76796f77e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:58.979735 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2dd31-ac68-4138-938a-ec76796f77e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:58.981207 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2dd31-ac68-4138-938a-ec76796f77e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:58.981385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2dd31-ac68-4138-938a-ec76796f77e2 admin admin] PATH_INFO: `/v3/projects/92d38f701c8b43a7b032d3d2e8db2b86/users/95ff0036c1244de9b49b8f2ce85cffee/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:58.999871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2dd31-ac68-4138-938a-ec76796f77e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d38f701c8b43a7b032d3d2e8db2b86, user_id=95ff0036c1244de9b49b8f2ce85cffee, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:59.002906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2dd31-ac68-4138-938a-ec76796f77e2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:59.021656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 812/1633] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:58 2022] PUT /identity/v3/projects/92d38f701c8b43a7b032d3d2e8db2b86/users/95ff0036c1244de9b49b8f2ce85cffee/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:59.022911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2dd31-ac68-4138-938a-ec76796f77e2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:59.054748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1163d7-79f7-48cc-9745-88a7a95d8af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:59.057634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1163d7-79f7-48cc-9745-88a7a95d8af1 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:59.085840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 822/1634] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:59.089637 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1c09-413b-49e4-abfd-a56b47ff752f None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:59.089942 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1c09-413b-49e4-abfd-a56b47ff752f None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:59.090294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1c09-413b-49e4-abfd-a56b47ff752f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:59.136886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2dd31-ac68-4138-938a-ec76796f77e2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:59.147999 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ce86b-4873-4455-b4a0-71be35412bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:59.148676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ce86b-4873-4455-b4a0-71be35412bff service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:59.148989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ce86b-4873-4455-b4a0-71be35412bff service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:59.149347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ce86b-4873-4455-b4a0-71be35412bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:59.158575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-8bcf1c09-413b-49e4-abfd-a56b47ff752f None None] MFA Rules not processed for user `5c61e25bf0044afb9634ca582c09e95e`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:59.160328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8bcf1c09-413b-49e4-abfd-a56b47ff752f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:59.223211 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ce86b-4873-4455-b4a0-71be35412bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:59.225989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ce86b-4873-4455-b4a0-71be35412bff service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:59.246042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 813/1635] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:59.259814 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ce86b-4873-4455-b4a0-71be35412bff service nova] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:59.317112 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 823/1636] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:59.317112 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf1c09-413b-49e4-abfd-a56b47ff752f None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:59.346245 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ce86b-4873-4455-b4a0-71be35412bff service nova] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:59.351741 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b917d9-980b-4f82-a02c-a0b4440f33ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:59.353038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b917d9-980b-4f82-a02c-a0b4440f33ec admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:59.353317 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b917d9-980b-4f82-a02c-a0b4440f33ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:59.353587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b917d9-980b-4f82-a02c-a0b4440f33ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:59.354373 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b917d9-980b-4f82-a02c-a0b4440f33ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:59.356184 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b917d9-980b-4f82-a02c-a0b4440f33ec admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:59.377528 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 814/1637] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:59.392256 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b917d9-980b-4f82-a02c-a0b4440f33ec admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:59.490007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf1c09-413b-49e4-abfd-a56b47ff752f None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:59.503931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f2380-1416-4e30-8652-360b6a110400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:59.505418 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f2380-1416-4e30-8652-360b6a110400 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:59.506792 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f2380-1416-4e30-8652-360b6a110400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:59.507157 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f2380-1416-4e30-8652-360b6a110400 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:59.509230 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f2380-1416-4e30-8652-360b6a110400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:59.514045 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f2380-1416-4e30-8652-360b6a110400 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:59.527390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b917d9-980b-4f82-a02c-a0b4440f33ec admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:59.537030 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837bdcc-dc6f-4a51-a9e4-937387e9a5c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:59.537793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837bdcc-dc6f-4a51-a9e4-937387e9a5c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:59.538245 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837bdcc-dc6f-4a51-a9e4-937387e9a5c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:59.542604 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 824/1638] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:59.542764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837bdcc-dc6f-4a51-a9e4-937387e9a5c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:59.542861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f2380-1416-4e30-8652-360b6a110400 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:59.565690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837bdcc-dc6f-4a51-a9e4-937387e9a5c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:59.567469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f2380-1416-4e30-8652-360b6a110400 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:59.568956 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837bdcc-dc6f-4a51-a9e4-937387e9a5c9 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:59.579155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609fabf-d006-44b9-a744-0b00e0296523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:59.580170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609fabf-d006-44b9-a744-0b00e0296523 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:59.581993 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609fabf-d006-44b9-a744-0b00e0296523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:59.583461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609fabf-d006-44b9-a744-0b00e0296523 admin admin] PATH_INFO: `/v3/projects/c1fae5156a6f4d48879dbdb0afe0e3b6/users/9c34f0f16fbb4d1cb6fe6757d018e861/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:59.588138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609fabf-d006-44b9-a744-0b00e0296523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1fae5156a6f4d48879dbdb0afe0e3b6, user_id=9c34f0f16fbb4d1cb6fe6757d018e861, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:59.592832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609fabf-d006-44b9-a744-0b00e0296523 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:59.593615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 815/1639] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:59.594738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837bdcc-dc6f-4a51-a9e4-937387e9a5c9 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:59.616775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837bdcc-dc6f-4a51-a9e4-937387e9a5c9 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:59.632881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 825/1640] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:59 2022] PUT /identity/v3/projects/c1fae5156a6f4d48879dbdb0afe0e3b6/users/9c34f0f16fbb4d1cb6fe6757d018e861/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:59.634580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf99371-edab-4b68-acb2-e727a816498c None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:59.636900 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf99371-edab-4b68-acb2-e727a816498c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:59.637288 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf99371-edab-4b68-acb2-e727a816498c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:59.704905 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-7bf99371-edab-4b68-acb2-e727a816498c None None] MFA Rules not processed for user `9c34f0f16fbb4d1cb6fe6757d018e861`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:59.707104 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7bf99371-edab-4b68-acb2-e727a816498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:59.756160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed1cb4-3a75-4d39-b72e-038ee162ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:59.757211 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed1cb4-3a75-4d39-b72e-038ee162ad31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:59.757495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed1cb4-3a75-4d39-b72e-038ee162ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:59.757771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed1cb4-3a75-4d39-b72e-038ee162ad31 admin admin] PATH_INFO: `/v3/projects/92d38f701c8b43a7b032d3d2e8db2b86/users/95ff0036c1244de9b49b8f2ce85cffee/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:59.761578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed1cb4-3a75-4d39-b72e-038ee162ad31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d38f701c8b43a7b032d3d2e8db2b86, user_id=95ff0036c1244de9b49b8f2ce85cffee, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:59.764341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed1cb4-3a75-4d39-b72e-038ee162ad31 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:59.808470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 816/1641] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:59 2022] PUT /identity/v3/projects/92d38f701c8b43a7b032d3d2e8db2b86/users/95ff0036c1244de9b49b8f2ce85cffee/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:59.812260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 826/1642] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:59.813171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf99371-edab-4b68-acb2-e727a816498c None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:59.817193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bd181-c7bc-4a89-aa7b-8994d381210d None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:59.824123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bd181-c7bc-4a89-aa7b-8994d381210d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:59.824775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bd181-c7bc-4a89-aa7b-8994d381210d None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:59.836353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 817/1643] 10.222.0.79 () {54 vars in 912 bytes} [Mon Feb 21 01:37:59 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:37:59.837958 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf99371-edab-4b68-acb2-e727a816498c None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:59.840776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5ec9-3e08-4b30-a9c3-7c51dace4223 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:59.841137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5ec9-3e08-4b30-a9c3-7c51dace4223 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:59.841505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5ec9-3e08-4b30-a9c3-7c51dace4223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:59.886401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-b04e5ec9-3e08-4b30-a9c3-7c51dace4223 None None] MFA Rules not processed for user `95ff0036c1244de9b49b8f2ce85cffee`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:59.887795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b04e5ec9-3e08-4b30-a9c3-7c51dace4223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:59.965637 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed295ac0-a18b-4422-99a0-235df4bb7ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:59.968442 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed295ac0-a18b-4422-99a0-235df4bb7ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:59.970139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed295ac0-a18b-4422-99a0-235df4bb7ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:59.970892 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed295ac0-a18b-4422-99a0-235df4bb7ef9 admin admin] PATH_INFO: `/v3/users/2e6db154a549420aa58b14ef9c4c5f31` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:59.974953 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed295ac0-a18b-4422-99a0-235df4bb7ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6db154a549420aa58b14ef9c4c5f31)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:59.978088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed295ac0-a18b-4422-99a0-235df4bb7ef9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:59.983334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 818/1644] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:59.996135 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e5ec9-3e08-4b30-a9c3-7c51dace4223 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:00.088493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ed295ac0-a18b-4422-99a0-235df4bb7ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6db154a549420aa58b14ef9c4c5f31'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:00.100466 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ed295ac0-a18b-4422-99a0-235df4bb7ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6db154a549420aa58b14ef9c4c5f31'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:00.111977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e5ec9-3e08-4b30-a9c3-7c51dace4223 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:00.118018 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ed295ac0-a18b-4422-99a0-235df4bb7ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6db154a549420aa58b14ef9c4c5f31'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:00.119162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ed295ac0-a18b-4422-99a0-235df4bb7ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6db154a549420aa58b14ef9c4c5f31'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:00.124746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b53c1-f93a-46f2-9ee8-61975276bd7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:00.125419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b53c1-f93a-46f2-9ee8-61975276bd7e service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:00.125702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b53c1-f93a-46f2-9ee8-61975276bd7e service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:00.125973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b53c1-f93a-46f2-9ee8-61975276bd7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:00.126867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ed295ac0-a18b-4422-99a0-235df4bb7ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6db154a549420aa58b14ef9c4c5f31'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:00.132696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8d0b53c1-f93a-46f2-9ee8-61975276bd7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:00.133693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 827/1645] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:37:59 2022] DELETE /identity/v3/users/2e6db154a549420aa58b14ef9c4c5f31 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:00.138736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207bafe-afda-4c93-a586-4deda590c83a None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:00.139184 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207bafe-afda-4c93-a586-4deda590c83a None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:00.139561 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207bafe-afda-4c93-a586-4deda590c83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:00.164224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-e207bafe-afda-4c93-a586-4deda590c83a None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:00.166450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e207bafe-afda-4c93-a586-4deda590c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:00.260019 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 828/1646] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:00.261480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50a483-6707-488c-81d5-7dd8e732b5d2 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:00.261878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50a483-6707-488c-81d5-7dd8e732b5d2 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:00.262232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50a483-6707-488c-81d5-7dd8e732b5d2 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:00.264113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 829/1647] 10.222.0.79 () {54 vars in 912 bytes} [Mon Feb 21 01:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:38:00.264868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50a483-6707-488c-81d5-7dd8e732b5d2 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:00.266994 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-af50a483-6707-488c-81d5-7dd8e732b5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:00.271264 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b53c1-f93a-46f2-9ee8-61975276bd7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:00.272750 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b53c1-f93a-46f2-9ee8-61975276bd7e service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:00.309907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 819/1648] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:59 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:00.311497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc398d-ebf5-4be6-85b4-7a11209c2b0b None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:00.311787 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc398d-ebf5-4be6-85b4-7a11209c2b0b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:00.312067 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc398d-ebf5-4be6-85b4-7a11209c2b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:00.353954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50a483-6707-488c-81d5-7dd8e732b5d2 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:00.359477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7380b-8490-4495-b637-66fa5e7079ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:00.360191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7380b-8490-4495-b637-66fa5e7079ba service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:00.361012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7380b-8490-4495-b637-66fa5e7079ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:00.361293 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7380b-8490-4495-b637-66fa5e7079ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:00.363255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fae7380b-8490-4495-b637-66fa5e7079ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:00.376223 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-02dc398d-ebf5-4be6-85b4-7a11209c2b0b None None] MFA Rules not processed for user `043b79a846ed41a6a446a1c533068af9`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:00.379111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-02dc398d-ebf5-4be6-85b4-7a11209c2b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:00.463390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7380b-8490-4495-b637-66fa5e7079ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:00.466559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7380b-8490-4495-b637-66fa5e7079ba service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:00.478900 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 830/1649] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:00.481163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd804cd-f468-4278-9c87-656e7f2fcf03 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:00.481686 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd804cd-f468-4278-9c87-656e7f2fcf03 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:00.482166 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd804cd-f468-4278-9c87-656e7f2fcf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:00.508001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-bdd804cd-f468-4278-9c87-656e7f2fcf03 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:00.511443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-bdd804cd-f468-4278-9c87-656e7f2fcf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:00.549305 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 820/1650] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:00.550683 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba746a2-2a70-4db5-87d7-1c4c7b40cc7e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:00.550971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba746a2-2a70-4db5-87d7-1c4c7b40cc7e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:00.551246 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba746a2-2a70-4db5-87d7-1c4c7b40cc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:00.605050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 831/1651] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:00.609082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd804cd-f468-4278-9c87-656e7f2fcf03 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:00.610687 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-bdd804cd-f468-4278-9c87-656e7f2fcf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:00.614706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0ba746a2-2a70-4db5-87d7-1c4c7b40cc7e None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:00.623361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0ba746a2-2a70-4db5-87d7-1c4c7b40cc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:00.625430 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd804cd-f468-4278-9c87-656e7f2fcf03 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:00.629643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca636d1-b230-469e-8fd6-19f047cdfc37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:00.630341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca636d1-b230-469e-8fd6-19f047cdfc37 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:00.630624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca636d1-b230-469e-8fd6-19f047cdfc37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:00.630898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca636d1-b230-469e-8fd6-19f047cdfc37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:00.644136 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca636d1-b230-469e-8fd6-19f047cdfc37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:00.645755 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca636d1-b230-469e-8fd6-19f047cdfc37 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:00.657995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 821/1652] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:00.659121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02689dfd-5dd0-4521-ae9d-7d6967b951b0 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:00.659405 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02689dfd-5dd0-4521-ae9d-7d6967b951b0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:00.659677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02689dfd-5dd0-4521-ae9d-7d6967b951b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:00.674609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 832/1653] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:00.676678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca636d1-b230-469e-8fd6-19f047cdfc37 service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:00.679302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fca636d1-b230-469e-8fd6-19f047cdfc37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:00.710907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-02689dfd-5dd0-4521-ae9d-7d6967b951b0 None None] MFA Rules not processed for user `043b79a846ed41a6a446a1c533068af9`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:00.712275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-02689dfd-5dd0-4521-ae9d-7d6967b951b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:00.765051 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 822/1654] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:00.848800 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca636d1-b230-469e-8fd6-19f047cdfc37 service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:00.861240 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a452dda-c1b7-48d0-bf51-424a0a9ced7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:00.862140 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452dda-c1b7-48d0-bf51-424a0a9ced7f service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:00.862140 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452dda-c1b7-48d0-bf51-424a0a9ced7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:00.862380 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452dda-c1b7-48d0-bf51-424a0a9ced7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:00.901229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a452dda-c1b7-48d0-bf51-424a0a9ced7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:00.903852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a452dda-c1b7-48d0-bf51-424a0a9ced7f service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:00.934969 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 833/1655] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:01.759249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02689dfd-5dd0-4521-ae9d-7d6967b951b0 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:01.769082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02689dfd-5dd0-4521-ae9d-7d6967b951b0 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:01.778820 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c7c32-cbd2-4ebd-a7f2-fc439a84b166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:01.779511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c7c32-cbd2-4ebd-a7f2-fc439a84b166 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:01.780340 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c7c32-cbd2-4ebd-a7f2-fc439a84b166 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:01.780625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c7c32-cbd2-4ebd-a7f2-fc439a84b166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:01.811884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c7c32-cbd2-4ebd-a7f2-fc439a84b166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:01.813726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c7c32-cbd2-4ebd-a7f2-fc439a84b166 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:01.851975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 823/1656] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:02.041293 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a452dda-c1b7-48d0-bf51-424a0a9ced7f service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:02.042907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-4a452dda-c1b7-48d0-bf51-424a0a9ced7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:02.071493 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c7c32-cbd2-4ebd-a7f2-fc439a84b166 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:02.072686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-664c7c32-cbd2-4ebd-a7f2-fc439a84b166 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:02.105357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a452dda-c1b7-48d0-bf51-424a0a9ced7f service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:02.130825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c7c32-cbd2-4ebd-a7f2-fc439a84b166 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:02.138635 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:02.139506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:02.139784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:02.147903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] PATH_INFO: `/v3/projects/571cfccc6cac4ab88b761ee6f28a0b26` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:02.153233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=571cfccc6cac4ab88b761ee6f28a0b26)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:02.159505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: WARNING py.warnings [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:38:02.159505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: warnings.warn(msg) Feb 21 01:38:02.159505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: Feb 21 01:38:02.160795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:02.164025 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e756a7-7ef3-41fc-b278-0f502da1a095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:02.166185 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e756a7-7ef3-41fc-b278-0f502da1a095 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:02.166510 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e756a7-7ef3-41fc-b278-0f502da1a095 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:02.166784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e756a7-7ef3-41fc-b278-0f502da1a095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:02.206895 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e756a7-7ef3-41fc-b278-0f502da1a095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:02.221422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e756a7-7ef3-41fc-b278-0f502da1a095 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:02.281768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 824/1657] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:02.284084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e756a7-7ef3-41fc-b278-0f502da1a095 service nova] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:02.291819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d2e756a7-7ef3-41fc-b278-0f502da1a095 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:02.374401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e756a7-7ef3-41fc-b278-0f502da1a095 service nova] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:02.459185 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '571cfccc6cac4ab88b761ee6f28a0b26', 'request_id': 'req-245e89e4-a0cd-4e58-964d-6b6358a252c3'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.493460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '571cfccc6cac4ab88b761ee6f28a0b26', 'request_id': 'req-245e89e4-a0cd-4e58-964d-6b6358a252c3'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.520353 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '571cfccc6cac4ab88b761ee6f28a0b26', 'request_id': 'req-245e89e4-a0cd-4e58-964d-6b6358a252c3'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.589109 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed86ef-5c34-470d-a826-a57a9a9ddf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:02.594059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed86ef-5c34-470d-a826-a57a9a9ddf02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:02.594581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed86ef-5c34-470d-a826-a57a9a9ddf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:02.596031 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed86ef-5c34-470d-a826-a57a9a9ddf02 admin admin] PATH_INFO: `/v3/users/ed2adcaaec4642d3a275317109798486` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:02.601775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed86ef-5c34-470d-a826-a57a9a9ddf02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2adcaaec4642d3a275317109798486)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:02.605923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: WARNING py.warnings [None req-64ed86ef-5c34-470d-a826-a57a9a9ddf02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:38:02.605923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: warnings.warn(msg) Feb 21 01:38:02.605923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: Feb 21 01:38:02.609781 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed86ef-5c34-470d-a826-a57a9a9ddf02 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:02.611072 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] The token cache is being invalidate because project 571cfccc6cac4ab88b761ee6f28a0b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:02.611376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.613150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.622453 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 834/1658] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:02 2022] DELETE /identity/v3/projects/571cfccc6cac4ab88b761ee6f28a0b26 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:02.626425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:02.632091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:02.695456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e89e4-a0cd-4e58-964d-6b6358a252c3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:02.708902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:02.710165 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:02.710690 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:02.711197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] PATH_INFO: `/v3/users/5c61e25bf0044afb9634ca582c09e95e` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:02.714991 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c61e25bf0044afb9634ca582c09e95e)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:02.717754 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:02.809754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-64ed86ef-5c34-470d-a826-a57a9a9ddf02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2adcaaec4642d3a275317109798486'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.846841 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c61e25bf0044afb9634ca582c09e95e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.848319 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-64ed86ef-5c34-470d-a826-a57a9a9ddf02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2adcaaec4642d3a275317109798486'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.871979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c61e25bf0044afb9634ca582c09e95e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.892166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-64ed86ef-5c34-470d-a826-a57a9a9ddf02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2adcaaec4642d3a275317109798486'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.893412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-64ed86ef-5c34-470d-a826-a57a9a9ddf02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2adcaaec4642d3a275317109798486'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.893937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-64ed86ef-5c34-470d-a826-a57a9a9ddf02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2adcaaec4642d3a275317109798486'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.896596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c61e25bf0044afb9634ca582c09e95e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.897480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c61e25bf0044afb9634ca582c09e95e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.949898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c61e25bf0044afb9634ca582c09e95e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:02.952334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 825/1659] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:02 2022] DELETE /identity/v3/users/ed2adcaaec4642d3a275317109798486 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:02.958643 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f2da1-dd0c-4db5-a785-28f11be63d9d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:02.958643 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f2da1-dd0c-4db5-a785-28f11be63d9d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:02.958643 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f2da1-dd0c-4db5-a785-28f11be63d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:02.974450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 835/1660] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:02 2022] DELETE /identity/v3/users/5c61e25bf0044afb9634ca582c09e95e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:03.003836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-ee2f2da1-dd0c-4db5-a785-28f11be63d9d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:03.011152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ee2f2da1-dd0c-4db5-a785-28f11be63d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:03.248855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 826/1661] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:03.260845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:03.263551 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:03.429710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd026300-24ed-4e1e-9f8c-f0f5b54e56e3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:03.434523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f559b75-d2dd-4c61-8d88-1912bc2819a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:03.435259 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f559b75-d2dd-4c61-8d88-1912bc2819a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:03.436316 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f559b75-d2dd-4c61-8d88-1912bc2819a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:03.436316 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f559b75-d2dd-4c61-8d88-1912bc2819a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:03.458175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f559b75-d2dd-4c61-8d88-1912bc2819a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:03.460544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f559b75-d2dd-4c61-8d88-1912bc2819a9 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:03.482589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 836/1662] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:03.677482 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbad52f-6502-41e4-ba7d-fb32373b68e4 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:03.678602 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbad52f-6502-41e4-ba7d-fb32373b68e4 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:03.679106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbad52f-6502-41e4-ba7d-fb32373b68e4 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:03.713147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 827/1663] 10.222.0.79 () {54 vars in 912 bytes} [Mon Feb 21 01:38:03 2022] GET /identity => generated 270 bytes in 38 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:38:03.719253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa505303-b69d-4d00-9db8-4aa67144d51e None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:03.719529 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa505303-b69d-4d00-9db8-4aa67144d51e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:03.720031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa505303-b69d-4d00-9db8-4aa67144d51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:03.825623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-aa505303-b69d-4d00-9db8-4aa67144d51e None None] MFA Rules not processed for user `3f00b174c88547e2ab799d89a50d5b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:03.832339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-aa505303-b69d-4d00-9db8-4aa67144d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:03.870110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 837/1664] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:38:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:04.020221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbad52f-6502-41e4-ba7d-fb32373b68e4 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:04.021973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6dbad52f-6502-41e4-ba7d-fb32373b68e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:04.054704 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbad52f-6502-41e4-ba7d-fb32373b68e4 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:04.107461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355df8a-e977-46b0-8701-709299404569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:04.112686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355df8a-e977-46b0-8701-709299404569 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:04.113509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355df8a-e977-46b0-8701-709299404569 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:04.113683 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355df8a-e977-46b0-8701-709299404569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:04.136261 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355df8a-e977-46b0-8701-709299404569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:04.140196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355df8a-e977-46b0-8701-709299404569 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:04.150080 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 828/1665] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:04.630009 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa505303-b69d-4d00-9db8-4aa67144d51e None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:04.631489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-aa505303-b69d-4d00-9db8-4aa67144d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:04.673358 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa505303-b69d-4d00-9db8-4aa67144d51e None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:04.696560 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b340af3-9e95-4bbb-ba9e-3c6d87276867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:04.698804 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b340af3-9e95-4bbb-ba9e-3c6d87276867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:04.699535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b340af3-9e95-4bbb-ba9e-3c6d87276867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:04.700103 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b340af3-9e95-4bbb-ba9e-3c6d87276867 admin admin] PATH_INFO: `/v3/projects/4230e86ded534c42b85e8fda4e99a50e` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:04.705024 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b340af3-9e95-4bbb-ba9e-3c6d87276867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4230e86ded534c42b85e8fda4e99a50e)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:04.708372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b340af3-9e95-4bbb-ba9e-3c6d87276867 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:04.785399 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-7b340af3-9e95-4bbb-ba9e-3c6d87276867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4230e86ded534c42b85e8fda4e99a50e', 'request_id': 'req-7b340af3-9e95-4bbb-ba9e-3c6d87276867'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:04.795578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-7b340af3-9e95-4bbb-ba9e-3c6d87276867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4230e86ded534c42b85e8fda4e99a50e', 'request_id': 'req-7b340af3-9e95-4bbb-ba9e-3c6d87276867'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:04.828103 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-7b340af3-9e95-4bbb-ba9e-3c6d87276867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4230e86ded534c42b85e8fda4e99a50e', 'request_id': 'req-7b340af3-9e95-4bbb-ba9e-3c6d87276867'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:04.864119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aff0f2-407f-4d6b-886a-a6aaefca89d6 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:04.864297 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-7b340af3-9e95-4bbb-ba9e-3c6d87276867 admin admin] The token cache is being invalidate because project 4230e86ded534c42b85e8fda4e99a50e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:04.864654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-7b340af3-9e95-4bbb-ba9e-3c6d87276867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:04.865010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aff0f2-407f-4d6b-886a-a6aaefca89d6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:04.865456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aff0f2-407f-4d6b-886a-a6aaefca89d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:04.865724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-7b340af3-9e95-4bbb-ba9e-3c6d87276867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:04.867965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 838/1666] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:04 2022] DELETE /identity/v3/projects/4230e86ded534c42b85e8fda4e99a50e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:04.876706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0e955-2102-4a37-800f-70dd589e0103 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:04.877982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0e955-2102-4a37-800f-70dd589e0103 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:04.878491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0e955-2102-4a37-800f-70dd589e0103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:04.926475 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-a3aff0f2-407f-4d6b-886a-a6aaefca89d6 None None] MFA Rules not processed for user `0c131301aa22491f8b1feb32d006ea62`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:04.928086 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a3aff0f2-407f-4d6b-886a-a6aaefca89d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:04.928281 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-3be0e955-2102-4a37-800f-70dd589e0103 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:04.929727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3be0e955-2102-4a37-800f-70dd589e0103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:05.030387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 839/1667] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:05.036913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ef6a6-5673-493e-b7d8-fad54b623dbb None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:05.037360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ef6a6-5673-493e-b7d8-fad54b623dbb None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:05.037796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ef6a6-5673-493e-b7d8-fad54b623dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:05.080586 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-245ef6a6-5673-493e-b7d8-fad54b623dbb None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:05.081722 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-245ef6a6-5673-493e-b7d8-fad54b623dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:05.112316 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 840/1668] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:05.114286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebe2c7-49ff-4d27-baf9-9667ce958866 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:05.114898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebe2c7-49ff-4d27-baf9-9667ce958866 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:05.115408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebe2c7-49ff-4d27-baf9-9667ce958866 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:05.124897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 841/1669] 10.222.0.79 () {54 vars in 960 bytes} [Mon Feb 21 01:38:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:38:05.126181 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebe2c7-49ff-4d27-baf9-9667ce958866 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:05.134190 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 829/1670] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:05.134190 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f30b29-7483-4846-b4fb-f83ba069d9dd None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:05.134816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f30b29-7483-4846-b4fb-f83ba069d9dd None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:05.134816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f30b29-7483-4846-b4fb-f83ba069d9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:05.157104 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebe2c7-49ff-4d27-baf9-9667ce958866 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:05.166476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750f84a-4b43-4e3e-8e2a-666a8ffacebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:05.167705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f84a-4b43-4e3e-8e2a-666a8ffacebd admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:05.168068 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f84a-4b43-4e3e-8e2a-666a8ffacebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:05.168414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f84a-4b43-4e3e-8e2a-666a8ffacebd admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:05.169232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750f84a-4b43-4e3e-8e2a-666a8ffacebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:05.169671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750f84a-4b43-4e3e-8e2a-666a8ffacebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:05.171742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750f84a-4b43-4e3e-8e2a-666a8ffacebd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:05.184925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-c1f30b29-7483-4846-b4fb-f83ba069d9dd None None] MFA Rules not processed for user `02e7385005924d4f8c220c986b9866de`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:05.187154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c1f30b29-7483-4846-b4fb-f83ba069d9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:05.199688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 842/1671] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:05.200835 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750f84a-4b43-4e3e-8e2a-666a8ffacebd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:05.203448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3750f84a-4b43-4e3e-8e2a-666a8ffacebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:05.242110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750f84a-4b43-4e3e-8e2a-666a8ffacebd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:05.250888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:05.251764 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:05.252052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:05.252332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] PATH_INFO: `/v3/projects/9067bad03c0f423c82aa89ddf9dcfd5d` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:05.253988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9067bad03c0f423c82aa89ddf9dcfd5d)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:05.256299 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:05.292712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 830/1672] 10.222.0.79 () {58 vars in 1057 bytes} [Mon Feb 21 01:38:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:05.293875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f30b29-7483-4846-b4fb-f83ba069d9dd None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:05.305868 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f30b29-7483-4846-b4fb-f83ba069d9dd None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:05.332502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4088c1-ddda-4f0a-a563-46bd03aa8a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:05.333637 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4088c1-ddda-4f0a-a563-46bd03aa8a4f admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:05.334084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4088c1-ddda-4f0a-a563-46bd03aa8a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:05.334593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4088c1-ddda-4f0a-a563-46bd03aa8a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:05.335291 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4088c1-ddda-4f0a-a563-46bd03aa8a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:05.337443 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4088c1-ddda-4f0a-a563-46bd03aa8a4f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:05.389279 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9067bad03c0f423c82aa89ddf9dcfd5d', 'request_id': 'req-ce961292-168e-4c56-bee7-803269683df3'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:05.395539 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9067bad03c0f423c82aa89ddf9dcfd5d', 'request_id': 'req-ce961292-168e-4c56-bee7-803269683df3'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:05.404351 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 831/1673] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:05 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:05.405653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4088c1-ddda-4f0a-a563-46bd03aa8a4f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:05.409028 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ce4088c1-ddda-4f0a-a563-46bd03aa8a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:05.412981 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9067bad03c0f423c82aa89ddf9dcfd5d', 'request_id': 'req-ce961292-168e-4c56-bee7-803269683df3'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:05.431663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] The token cache is being invalidate because project 9067bad03c0f423c82aa89ddf9dcfd5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:05.431940 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:05.433842 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:05.441895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 843/1674] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:05 2022] DELETE /identity/v3/projects/9067bad03c0f423c82aa89ddf9dcfd5d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:05.445023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:05.445460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:05.518512 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4088c1-ddda-4f0a-a563-46bd03aa8a4f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:05.533072 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6150a6d-3b61-454f-87b8-188bdc1c3fb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:05.534150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6150a6d-3b61-454f-87b8-188bdc1c3fb2 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:05.534703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6150a6d-3b61-454f-87b8-188bdc1c3fb2 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:05.535582 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6150a6d-3b61-454f-87b8-188bdc1c3fb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:05.541130 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e6150a6d-3b61-454f-87b8-188bdc1c3fb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:05.645443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce961292-168e-4c56-bee7-803269683df3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:05.660928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6150a6d-3b61-454f-87b8-188bdc1c3fb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:05.662755 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6150a6d-3b61-454f-87b8-188bdc1c3fb2 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:05.679380 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 832/1675] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:05.680275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6150a6d-3b61-454f-87b8-188bdc1c3fb2 service nova] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:05.681774 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e6150a6d-3b61-454f-87b8-188bdc1c3fb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:05.778884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6150a6d-3b61-454f-87b8-188bdc1c3fb2 service nova] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:05.787158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d15bcf-3ecd-41d5-ad5d-d516955aa82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:05.788481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15bcf-3ecd-41d5-ad5d-d516955aa82a admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:05.788766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15bcf-3ecd-41d5-ad5d-d516955aa82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:05.789043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15bcf-3ecd-41d5-ad5d-d516955aa82a admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:05.789773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d15bcf-3ecd-41d5-ad5d-d516955aa82a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:05.792791 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d15bcf-3ecd-41d5-ad5d-d516955aa82a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:05.797924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad727943-082d-4238-a43c-236d3717fa58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02e7385005924d4f8c220c986b9866de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:05.801037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad727943-082d-4238-a43c-236d3717fa58 service placement] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:05.801773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad727943-082d-4238-a43c-236d3717fa58 service placement] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:05.802220 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad727943-082d-4238-a43c-236d3717fa58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:05.804940 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ad727943-082d-4238-a43c-236d3717fa58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:05.820037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad727943-082d-4238-a43c-236d3717fa58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:05.824393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad727943-082d-4238-a43c-236d3717fa58 service placement] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:05.844589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 844/1676] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:05.845871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad727943-082d-4238-a43c-236d3717fa58 service placement] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:05.849683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ad727943-082d-4238-a43c-236d3717fa58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:05.862602 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 833/1677] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:05 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:05.865370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d15bcf-3ecd-41d5-ad5d-d516955aa82a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:05.884309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad727943-082d-4238-a43c-236d3717fa58 service placement] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:05.904563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:05.905658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:05.906010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:05.906469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] PATH_INFO: `/v3/users/9c34f0f16fbb4d1cb6fe6757d018e861` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:05.908024 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c34f0f16fbb4d1cb6fe6757d018e861)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:05.910675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:05.911622 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d15bcf-3ecd-41d5-ad5d-d516955aa82a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:05.942891 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffcbaf-0912-4903-965d-ae61d404a851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:05.943785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffcbaf-0912-4903-965d-ae61d404a851 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:05.943924 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffcbaf-0912-4903-965d-ae61d404a851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:05.944203 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffcbaf-0912-4903-965d-ae61d404a851 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:05.944949 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffcbaf-0912-4903-965d-ae61d404a851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:05.947714 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffcbaf-0912-4903-965d-ae61d404a851 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:06.000498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 834/1678] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:06.000681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c34f0f16fbb4d1cb6fe6757d018e861'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:06.001477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffcbaf-0912-4903-965d-ae61d404a851 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:06.017377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c34f0f16fbb4d1cb6fe6757d018e861'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:06.039298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c34f0f16fbb4d1cb6fe6757d018e861'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:06.039862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffcbaf-0912-4903-965d-ae61d404a851 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:06.040523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c34f0f16fbb4d1cb6fe6757d018e861'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:06.051997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c34f0f16fbb4d1cb6fe6757d018e861'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:06.060777 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f039de-8c7a-4d57-83fd-016f25a63883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:06.061615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f039de-8c7a-4d57-83fd-016f25a63883 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:06.061910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f039de-8c7a-4d57-83fd-016f25a63883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:06.062236 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 845/1679] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:05 2022] DELETE /identity/v3/users/9c34f0f16fbb4d1cb6fe6757d018e861 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:06.066340 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f039de-8c7a-4d57-83fd-016f25a63883 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:06.072019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f039de-8c7a-4d57-83fd-016f25a63883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:06.075255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f039de-8c7a-4d57-83fd-016f25a63883 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:06.097300 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:06.099368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:06.108361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 835/1680] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:06.191940 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4f7de-c75a-4ff4-a835-7630e4a68dc1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:06.199192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e7fa4-990b-4316-810d-ab49ab4dbca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:06.201131 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7fa4-990b-4316-810d-ab49ab4dbca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:06.201892 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7fa4-990b-4316-810d-ab49ab4dbca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:06.202444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7fa4-990b-4316-810d-ab49ab4dbca3 admin admin] PATH_INFO: `/v3/projects/e5a544d60a47444181b0d5ac1e74b723/users/55e47792de3f4045b3e811d473685551/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:06.225114 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e7fa4-990b-4316-810d-ab49ab4dbca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a544d60a47444181b0d5ac1e74b723, user_id=55e47792de3f4045b3e811d473685551, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:06.230950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e7fa4-990b-4316-810d-ab49ab4dbca3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:06.247175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 846/1681] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:06 2022] PUT /identity/v3/projects/e5a544d60a47444181b0d5ac1e74b723/users/55e47792de3f4045b3e811d473685551/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:06.257099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e783f-ef29-4a90-97f7-885ade8a207b None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:06.258856 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e783f-ef29-4a90-97f7-885ade8a207b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:06.259388 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e783f-ef29-4a90-97f7-885ade8a207b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:06.301789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-a04e783f-ef29-4a90-97f7-885ade8a207b None None] MFA Rules not processed for user `55e47792de3f4045b3e811d473685551`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:06.304108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a04e783f-ef29-4a90-97f7-885ade8a207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:06.421493 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 836/1682] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:06.425898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e7fa4-990b-4316-810d-ab49ab4dbca3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:06.533368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e7fa4-990b-4316-810d-ab49ab4dbca3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:06.540115 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb5456-8420-4b40-88ce-1be3cb753a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:06.540990 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb5456-8420-4b40-88ce-1be3cb753a97 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:06.541467 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb5456-8420-4b40-88ce-1be3cb753a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:06.541934 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb5456-8420-4b40-88ce-1be3cb753a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:06.542980 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb5456-8420-4b40-88ce-1be3cb753a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:06.546239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb5456-8420-4b40-88ce-1be3cb753a97 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:06.614833 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 847/1683] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:06 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:06.616016 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e783f-ef29-4a90-97f7-885ade8a207b None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:06.632224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e783f-ef29-4a90-97f7-885ade8a207b None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:06.777588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a1033-13be-4a13-ba92-eb807e90becb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:06.779582 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a1033-13be-4a13-ba92-eb807e90becb admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:06.780530 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a1033-13be-4a13-ba92-eb807e90becb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:06.780932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a1033-13be-4a13-ba92-eb807e90becb admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:06.782962 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a1033-13be-4a13-ba92-eb807e90becb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:06.789821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a1033-13be-4a13-ba92-eb807e90becb admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:06.840402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 837/1684] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:06 2022] POST /identity/v3/users => generated 300 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:38:06.844068 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb5456-8420-4b40-88ce-1be3cb753a97 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:06.858743 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb5456-8420-4b40-88ce-1be3cb753a97 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:06.873031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb1b92-97cf-461c-8c04-1c0b0751f49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:06.873824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb1b92-97cf-461c-8c04-1c0b0751f49e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:06.874111 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb1b92-97cf-461c-8c04-1c0b0751f49e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:06.876009 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb1b92-97cf-461c-8c04-1c0b0751f49e admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:06.878494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb1b92-97cf-461c-8c04-1c0b0751f49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:06.883064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb1b92-97cf-461c-8c04-1c0b0751f49e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:06.948703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a1033-13be-4a13-ba92-eb807e90becb admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:06.950741 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 848/1685] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:38:06.954398 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a1033-13be-4a13-ba92-eb807e90becb admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:06.957624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e42933-4732-44e0-9dcf-4d9e60d04ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:06.958702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e42933-4732-44e0-9dcf-4d9e60d04ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:06.958990 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e42933-4732-44e0-9dcf-4d9e60d04ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:06.959266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e42933-4732-44e0-9dcf-4d9e60d04ed9 admin admin] PATH_INFO: `/v3/projects/46489dc54c8f43ee9bc6348e9717eb0c/users/697c13aee33441b7845430c3eb83c4a2/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:06.985105 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e42933-4732-44e0-9dcf-4d9e60d04ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46489dc54c8f43ee9bc6348e9717eb0c, user_id=697c13aee33441b7845430c3eb83c4a2, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:06.989410 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e42933-4732-44e0-9dcf-4d9e60d04ed9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:07.038457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 838/1686] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:06 2022] PUT /identity/v3/projects/46489dc54c8f43ee9bc6348e9717eb0c/users/697c13aee33441b7845430c3eb83c4a2/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:07.043082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb1b92-97cf-461c-8c04-1c0b0751f49e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:07.055759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb1b92-97cf-461c-8c04-1c0b0751f49e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:07.120666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410f54a-b49b-4744-80da-709ef810869e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:07.121178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410f54a-b49b-4744-80da-709ef810869e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:07.121734 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410f54a-b49b-4744-80da-709ef810869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:07.194171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e410f54a-b49b-4744-80da-709ef810869e None None] MFA Rules not processed for user `faac09d2bacd4759ada261c83b83362e`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:07.196236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e410f54a-b49b-4744-80da-709ef810869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:07.255868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf99b3-f122-4979-980a-d15864a99b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:07.261560 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf99b3-f122-4979-980a-d15864a99b7a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:07.264016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf99b3-f122-4979-980a-d15864a99b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:07.265602 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf99b3-f122-4979-980a-d15864a99b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:07.268435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf99b3-f122-4979-980a-d15864a99b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:07.275459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf99b3-f122-4979-980a-d15864a99b7a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:07.303997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 839/1687] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:07.315958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410f54a-b49b-4744-80da-709ef810869e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:07.317861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e410f54a-b49b-4744-80da-709ef810869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:07.327053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 849/1688] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:07.331315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf99b3-f122-4979-980a-d15864a99b7a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:07.360997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf99b3-f122-4979-980a-d15864a99b7a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:07.379992 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f774d-d821-47f7-85c2-3ef045a72187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:07.382038 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f774d-d821-47f7-85c2-3ef045a72187 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:07.382450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f774d-d821-47f7-85c2-3ef045a72187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:07.382811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f774d-d821-47f7-85c2-3ef045a72187 admin admin] PATH_INFO: `/v3/projects/46489dc54c8f43ee9bc6348e9717eb0c/users/697c13aee33441b7845430c3eb83c4a2/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:07.386980 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f774d-d821-47f7-85c2-3ef045a72187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46489dc54c8f43ee9bc6348e9717eb0c, user_id=697c13aee33441b7845430c3eb83c4a2, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:07.393321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f774d-d821-47f7-85c2-3ef045a72187 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:07.427247 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 850/1689] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:07 2022] PUT /identity/v3/projects/46489dc54c8f43ee9bc6348e9717eb0c/users/697c13aee33441b7845430c3eb83c4a2/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:07.428415 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f774d-d821-47f7-85c2-3ef045a72187 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:07.430153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-cf6f774d-d821-47f7-85c2-3ef045a72187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:07.533001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410f54a-b49b-4744-80da-709ef810869e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:07.615933 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f774d-d821-47f7-85c2-3ef045a72187 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:07.627504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:07.628512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:07.628798 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:07.629074 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107 admin admin] PATH_INFO: `/v3/projects/c1fae5156a6f4d48879dbdb0afe0e3b6` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:07.630578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1fae5156a6f4d48879dbdb0afe0e3b6)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:07.636013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:07.741094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adc8b3-bbc0-4181-8370-7b8e4ce7a84b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:07.741765 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adc8b3-bbc0-4181-8370-7b8e4ce7a84b service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:07.742043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adc8b3-bbc0-4181-8370-7b8e4ce7a84b service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:07.742857 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adc8b3-bbc0-4181-8370-7b8e4ce7a84b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:07.760042 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1fae5156a6f4d48879dbdb0afe0e3b6', 'request_id': 'req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:07.771981 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1fae5156a6f4d48879dbdb0afe0e3b6', 'request_id': 'req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:07.788734 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1fae5156a6f4d48879dbdb0afe0e3b6', 'request_id': 'req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:07.814847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107 admin admin] The token cache is being invalidate because project c1fae5156a6f4d48879dbdb0afe0e3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:07.815518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:07.816805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3e46bc9b-e97e-4d0e-9526-4f5436d0b107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:07.831280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 851/1690] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:07 2022] DELETE /identity/v3/projects/c1fae5156a6f4d48879dbdb0afe0e3b6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:07.835761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6823a-0ac2-48a2-ab8d-424596f643fe None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:07.837231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6823a-0ac2-48a2-ab8d-424596f643fe None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:07.837231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6823a-0ac2-48a2-ab8d-424596f643fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:07.896905 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adc8b3-bbc0-4181-8370-7b8e4ce7a84b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:07.898890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adc8b3-bbc0-4181-8370-7b8e4ce7a84b service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:07.900252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-3ff6823a-0ac2-48a2-ab8d-424596f643fe None None] MFA Rules not processed for user `697c13aee33441b7845430c3eb83c4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:07.902166 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3ff6823a-0ac2-48a2-ab8d-424596f643fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:07.935461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 840/1691] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:38:07.936825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a7e41-070b-4481-9190-9606b33f9625 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:07.937236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a7e41-070b-4481-9190-9606b33f9625 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:07.937516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a7e41-070b-4481-9190-9606b33f9625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:07.976057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4e7a7e41-070b-4481-9190-9606b33f9625 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:07.987011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4e7a7e41-070b-4481-9190-9606b33f9625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:08.086251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 852/1692] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:08.098729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6823a-0ac2-48a2-ab8d-424596f643fe None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:08.100600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3ff6823a-0ac2-48a2-ab8d-424596f643fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:08.133797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 841/1693] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:08.144816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f58440-f858-409d-bcd1-1f803ec13267 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:08.145112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f58440-f858-409d-bcd1-1f803ec13267 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:08.145392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f58440-f858-409d-bcd1-1f803ec13267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:08.212022 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-45f58440-f858-409d-bcd1-1f803ec13267 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:08.213287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-45f58440-f858-409d-bcd1-1f803ec13267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:08.254954 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 842/1694] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:08.255687 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6823a-0ac2-48a2-ab8d-424596f643fe None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:08.256119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f58440-f858-409d-bcd1-1f803ec13267 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:08.265079 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388692e-4968-414a-8c4a-fafd9a8ee37e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:08.266256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388692e-4968-414a-8c4a-fafd9a8ee37e service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:08.266256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388692e-4968-414a-8c4a-fafd9a8ee37e service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:08.267138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388692e-4968-414a-8c4a-fafd9a8ee37e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:08.282595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f58440-f858-409d-bcd1-1f803ec13267 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:08.289864 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d39894-b17a-46e2-b45f-ae0459ffd61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:08.290818 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d39894-b17a-46e2-b45f-ae0459ffd61a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:08.291298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d39894-b17a-46e2-b45f-ae0459ffd61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:08.292478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d39894-b17a-46e2-b45f-ae0459ffd61a admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:08.293649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d39894-b17a-46e2-b45f-ae0459ffd61a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:08.294250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d39894-b17a-46e2-b45f-ae0459ffd61a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:08.296411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d39894-b17a-46e2-b45f-ae0459ffd61a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:08.299270 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388692e-4968-414a-8c4a-fafd9a8ee37e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:08.301147 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388692e-4968-414a-8c4a-fafd9a8ee37e service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:08.320540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 843/1695] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:08.322412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d39894-b17a-46e2-b45f-ae0459ffd61a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:08.322564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 853/1696] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:08.377614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d39894-b17a-46e2-b45f-ae0459ffd61a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:08.404694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d878d5-302b-4754-8193-e107e2919434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:08.406584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d878d5-302b-4754-8193-e107e2919434 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:08.407412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d878d5-302b-4754-8193-e107e2919434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:08.407708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d878d5-302b-4754-8193-e107e2919434 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:08.408420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d878d5-302b-4754-8193-e107e2919434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:08.414152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d878d5-302b-4754-8193-e107e2919434 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:08.427127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388692e-4968-414a-8c4a-fafd9a8ee37e service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:08.430633 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0388692e-4968-414a-8c4a-fafd9a8ee37e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:08.471692 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388692e-4968-414a-8c4a-fafd9a8ee37e service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:08.486685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe73dc0-5b26-4731-b426-6c6009d8c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:08.489465 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe73dc0-5b26-4731-b426-6c6009d8c89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:08.489762 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe73dc0-5b26-4731-b426-6c6009d8c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:08.491330 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe73dc0-5b26-4731-b426-6c6009d8c89b admin admin] PATH_INFO: `/v3/users/55e47792de3f4045b3e811d473685551` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:08.497113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe73dc0-5b26-4731-b426-6c6009d8c89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e47792de3f4045b3e811d473685551)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:08.502622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe73dc0-5b26-4731-b426-6c6009d8c89b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:08.526313 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 844/1697] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:08 2022] POST /identity/v3/projects => generated 405 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:08.527922 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d878d5-302b-4754-8193-e107e2919434 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:08.654018 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ebe73dc0-5b26-4731-b426-6c6009d8c89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e47792de3f4045b3e811d473685551'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:08.677747 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ebe73dc0-5b26-4731-b426-6c6009d8c89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e47792de3f4045b3e811d473685551'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:08.684193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d878d5-302b-4754-8193-e107e2919434 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:08.701092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ebe73dc0-5b26-4731-b426-6c6009d8c89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e47792de3f4045b3e811d473685551'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:08.701727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d8b18-6a59-4b93-b1a8-ff4cd4645d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:08.702136 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ebe73dc0-5b26-4731-b426-6c6009d8c89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e47792de3f4045b3e811d473685551'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:08.702606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d8b18-6a59-4b93-b1a8-ff4cd4645d02 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:08.702969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d8b18-6a59-4b93-b1a8-ff4cd4645d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:08.703322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d8b18-6a59-4b93-b1a8-ff4cd4645d02 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:08.704121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d8b18-6a59-4b93-b1a8-ff4cd4645d02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:08.706505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d8b18-6a59-4b93-b1a8-ff4cd4645d02 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:08.722507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ebe73dc0-5b26-4731-b426-6c6009d8c89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e47792de3f4045b3e811d473685551'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:08.746893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 854/1698] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:08 2022] DELETE /identity/v3/users/55e47792de3f4045b3e811d473685551 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:08.748511 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70644f89-b349-48b6-b6c8-64dff0da2a09 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:08.757065 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 845/1699] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:08 2022] POST /identity/v3/users => generated 303 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:08.757250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70644f89-b349-48b6-b6c8-64dff0da2a09 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:08.757250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70644f89-b349-48b6-b6c8-64dff0da2a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:08.758965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d8b18-6a59-4b93-b1a8-ff4cd4645d02 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:08.773481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b80d8b18-6a59-4b93-b1a8-ff4cd4645d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:08.794048 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-70644f89-b349-48b6-b6c8-64dff0da2a09 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:08.795607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-70644f89-b349-48b6-b6c8-64dff0da2a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:08.798235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d8b18-6a59-4b93-b1a8-ff4cd4645d02 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:08.909133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb2ce4-fea9-4213-9f5b-d236b93859eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:08.909829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb2ce4-fea9-4213-9f5b-d236b93859eb admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:08.910117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb2ce4-fea9-4213-9f5b-d236b93859eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:08.911586 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb2ce4-fea9-4213-9f5b-d236b93859eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:08.914243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb2ce4-fea9-4213-9f5b-d236b93859eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:08.917796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb2ce4-fea9-4213-9f5b-d236b93859eb admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:08.936525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 846/1700] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:38:08.948056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb2ce4-fea9-4213-9f5b-d236b93859eb admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:08.948675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 855/1701] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:08.973932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70644f89-b349-48b6-b6c8-64dff0da2a09 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:08.975747 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb2ce4-fea9-4213-9f5b-d236b93859eb admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:08.977328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-70644f89-b349-48b6-b6c8-64dff0da2a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:08.999580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d18c1-f7a2-47bc-a392-f34dafd4af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:09.000286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d18c1-f7a2-47bc-a392-f34dafd4af44 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:09.000577 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d18c1-f7a2-47bc-a392-f34dafd4af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:09.000869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d18c1-f7a2-47bc-a392-f34dafd4af44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:09.005242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d18c1-f7a2-47bc-a392-f34dafd4af44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:09.012121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d18c1-f7a2-47bc-a392-f34dafd4af44 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:09.040648 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 847/1702] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:09.049213 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d18c1-f7a2-47bc-a392-f34dafd4af44 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:09.074963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d18c1-f7a2-47bc-a392-f34dafd4af44 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:09.104975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22b98c-e2f7-41c9-8628-1c074349d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:09.106105 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22b98c-e2f7-41c9-8628-1c074349d60d admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:09.106730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22b98c-e2f7-41c9-8628-1c074349d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:09.107011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22b98c-e2f7-41c9-8628-1c074349d60d admin admin] PATH_INFO: `/v3/projects/24d0b2c9ef4a4c30917bef6038cfbead/users/bb244d01a3c34f409b52f9625be7de57/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:09.137794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22b98c-e2f7-41c9-8628-1c074349d60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d0b2c9ef4a4c30917bef6038cfbead, user_id=bb244d01a3c34f409b52f9625be7de57, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:09.141098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22b98c-e2f7-41c9-8628-1c074349d60d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:09.154283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70644f89-b349-48b6-b6c8-64dff0da2a09 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:09.164068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 848/1703] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:09 2022] PUT /identity/v3/projects/24d0b2c9ef4a4c30917bef6038cfbead/users/bb244d01a3c34f409b52f9625be7de57/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:09.169794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d9e93-55c2-41cf-9998-36ae2acb6334 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:09.170218 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d9e93-55c2-41cf-9998-36ae2acb6334 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:09.170608 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d9e93-55c2-41cf-9998-36ae2acb6334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:09.205505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-3b4d9e93-55c2-41cf-9998-36ae2acb6334 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:09.213620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3b4d9e93-55c2-41cf-9998-36ae2acb6334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:09.255786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1036f-5cb9-40bc-9faf-fb6ac3cdcf80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:09.257101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1036f-5cb9-40bc-9faf-fb6ac3cdcf80 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:09.257384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1036f-5cb9-40bc-9faf-fb6ac3cdcf80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:09.257674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1036f-5cb9-40bc-9faf-fb6ac3cdcf80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:09.370523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 849/1704] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:09.416061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d9e93-55c2-41cf-9998-36ae2acb6334 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:09.425765 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1036f-5cb9-40bc-9faf-fb6ac3cdcf80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:09.427395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d9e93-55c2-41cf-9998-36ae2acb6334 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:09.431262 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1036f-5cb9-40bc-9faf-fb6ac3cdcf80 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:09.439238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45b72f-e45f-496b-bdda-fb602995c0f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:09.439913 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45b72f-e45f-496b-bdda-fb602995c0f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:09.440200 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45b72f-e45f-496b-bdda-fb602995c0f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:09.441239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45b72f-e45f-496b-bdda-fb602995c0f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:09.449531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 856/1705] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:09.457300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45b72f-e45f-496b-bdda-fb602995c0f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:09.466271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45b72f-e45f-496b-bdda-fb602995c0f3 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:09.493047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 850/1706] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:09.848389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfa06f-6145-4c44-b22f-be9a96c575eb None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:09.849918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfa06f-6145-4c44-b22f-be9a96c575eb None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:09.854305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfa06f-6145-4c44-b22f-be9a96c575eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:09.898127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-24cfa06f-6145-4c44-b22f-be9a96c575eb None None] MFA Rules not processed for user `0c131301aa22491f8b1feb32d006ea62`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:09.899549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-24cfa06f-6145-4c44-b22f-be9a96c575eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:09.994693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 857/1707] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:10.249652 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45b72f-e45f-496b-bdda-fb602995c0f3 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:10.251404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-fd45b72f-e45f-496b-bdda-fb602995c0f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:10.276883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45b72f-e45f-496b-bdda-fb602995c0f3 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:10.291560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:10.292443 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:10.292727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:10.293003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] PATH_INFO: `/v3/projects/e5a544d60a47444181b0d5ac1e74b723` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:10.296239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a544d60a47444181b0d5ac1e74b723)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:10.298623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:10.401181 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a544d60a47444181b0d5ac1e74b723', 'request_id': 'req-8728893b-2bf5-4fc3-b394-4e81d8f6d767'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:10.421629 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a544d60a47444181b0d5ac1e74b723', 'request_id': 'req-8728893b-2bf5-4fc3-b394-4e81d8f6d767'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:10.439750 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a544d60a47444181b0d5ac1e74b723', 'request_id': 'req-8728893b-2bf5-4fc3-b394-4e81d8f6d767'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:10.453896 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] The token cache is being invalidate because project e5a544d60a47444181b0d5ac1e74b723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:10.454640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:10.455645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:10.458268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 851/1708] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:10 2022] DELETE /identity/v3/projects/e5a544d60a47444181b0d5ac1e74b723 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:10.462154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfa06f-6145-4c44-b22f-be9a96c575eb None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:10.480068 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfa06f-6145-4c44-b22f-be9a96c575eb None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:10.588141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:10.589041 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:10.589475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:10.589759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] PATH_INFO: `/v3/users/697c13aee33441b7845430c3eb83c4a2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:10.591207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=697c13aee33441b7845430c3eb83c4a2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:10.593342 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:10.662373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697c13aee33441b7845430c3eb83c4a2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:10.677362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697c13aee33441b7845430c3eb83c4a2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:10.704204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697c13aee33441b7845430c3eb83c4a2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:10.706301 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697c13aee33441b7845430c3eb83c4a2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:10.715001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697c13aee33441b7845430c3eb83c4a2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:10.723810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 858/1709] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:10 2022] DELETE /identity/v3/users/697c13aee33441b7845430c3eb83c4a2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:10.965995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:10.974639 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:11.118975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728893b-2bf5-4fc3-b394-4e81d8f6d767 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:11.245786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:11.247878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:11.300216 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb6a1e-3b01-4c74-b107-ea644dab7cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:11.301343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6a1e-3b01-4c74-b107-ea644dab7cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:11.301822 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6a1e-3b01-4c74-b107-ea644dab7cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:11.302303 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6a1e-3b01-4c74-b107-ea644dab7cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:11.307862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f7fb6a1e-3b01-4c74-b107-ea644dab7cf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:11.429651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c084e-9c8e-4038-bf62-5adfd47ce0be admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:11.435492 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c500d9-76b3-4dcc-af53-0fe30388e0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:11.441464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c500d9-76b3-4dcc-af53-0fe30388e0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:11.441761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c500d9-76b3-4dcc-af53-0fe30388e0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:11.442975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c500d9-76b3-4dcc-af53-0fe30388e0a2 admin admin] PATH_INFO: `/v3/users/f52ee19cc9174fc39162cf79e68b487e` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:11.443840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c500d9-76b3-4dcc-af53-0fe30388e0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52ee19cc9174fc39162cf79e68b487e)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:11.446316 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c500d9-76b3-4dcc-af53-0fe30388e0a2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:11.481898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb6a1e-3b01-4c74-b107-ea644dab7cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:11.484816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb6a1e-3b01-4c74-b107-ea644dab7cf3 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:11.515516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 852/1710] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:38:11.517015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb6a1e-3b01-4c74-b107-ea644dab7cf3 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:11.521638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f7fb6a1e-3b01-4c74-b107-ea644dab7cf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:11.550781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-d3c500d9-76b3-4dcc-af53-0fe30388e0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52ee19cc9174fc39162cf79e68b487e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:11.567773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb6a1e-3b01-4c74-b107-ea644dab7cf3 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:11.572888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-d3c500d9-76b3-4dcc-af53-0fe30388e0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52ee19cc9174fc39162cf79e68b487e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:11.581715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397471ad-7f79-40dc-8663-f147a158ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:11.584012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397471ad-7f79-40dc-8663-f147a158ca47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:11.584702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397471ad-7f79-40dc-8663-f147a158ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:11.585778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397471ad-7f79-40dc-8663-f147a158ca47 admin admin] PATH_INFO: `/v3/projects/46489dc54c8f43ee9bc6348e9717eb0c` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:11.588229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397471ad-7f79-40dc-8663-f147a158ca47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46489dc54c8f43ee9bc6348e9717eb0c)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:11.592851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397471ad-7f79-40dc-8663-f147a158ca47 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:11.598410 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-d3c500d9-76b3-4dcc-af53-0fe30388e0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52ee19cc9174fc39162cf79e68b487e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:11.599850 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-d3c500d9-76b3-4dcc-af53-0fe30388e0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52ee19cc9174fc39162cf79e68b487e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:11.616509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-d3c500d9-76b3-4dcc-af53-0fe30388e0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52ee19cc9174fc39162cf79e68b487e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:11.625343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 859/1711] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:11 2022] DELETE /identity/v3/users/f52ee19cc9174fc39162cf79e68b487e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:11.654529 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f41bcd-f3d1-4b16-a40c-121553fecd69 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:11.655249 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f41bcd-f3d1-4b16-a40c-121553fecd69 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:11.657069 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f41bcd-f3d1-4b16-a40c-121553fecd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:11.722032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-94f41bcd-f3d1-4b16-a40c-121553fecd69 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:11.723289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-94f41bcd-f3d1-4b16-a40c-121553fecd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:11.732029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-397471ad-7f79-40dc-8663-f147a158ca47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46489dc54c8f43ee9bc6348e9717eb0c', 'request_id': 'req-397471ad-7f79-40dc-8663-f147a158ca47'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:11.746555 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-397471ad-7f79-40dc-8663-f147a158ca47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46489dc54c8f43ee9bc6348e9717eb0c', 'request_id': 'req-397471ad-7f79-40dc-8663-f147a158ca47'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:11.772727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-397471ad-7f79-40dc-8663-f147a158ca47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46489dc54c8f43ee9bc6348e9717eb0c', 'request_id': 'req-397471ad-7f79-40dc-8663-f147a158ca47'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:11.788145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-397471ad-7f79-40dc-8663-f147a158ca47 admin admin] The token cache is being invalidate because project 46489dc54c8f43ee9bc6348e9717eb0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:11.788723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-397471ad-7f79-40dc-8663-f147a158ca47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:11.791370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-397471ad-7f79-40dc-8663-f147a158ca47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:11.793667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 853/1712] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:11 2022] DELETE /identity/v3/projects/46489dc54c8f43ee9bc6348e9717eb0c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:11.795175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4ffa4-fc88-47b7-8c31-f73e1d0ea5d5 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:11.797971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4ffa4-fc88-47b7-8c31-f73e1d0ea5d5 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:11.798491 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4ffa4-fc88-47b7-8c31-f73e1d0ea5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:11.844687 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-90b4ffa4-fc88-47b7-8c31-f73e1d0ea5d5 None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:11.846042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-90b4ffa4-fc88-47b7-8c31-f73e1d0ea5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:11.955884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 860/1713] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:11.960326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a6113-1669-4621-baf1-2d135e13a1a6 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:11.960674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a6113-1669-4621-baf1-2d135e13a1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:11.961635 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a6113-1669-4621-baf1-2d135e13a1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:11.993979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-370a6113-1669-4621-baf1-2d135e13a1a6 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:11.997396 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-370a6113-1669-4621-baf1-2d135e13a1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:11.997944 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 854/1714] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:11.998893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4ffa4-fc88-47b7-8c31-f73e1d0ea5d5 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:12.000464 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-90b4ffa4-fc88-47b7-8c31-f73e1d0ea5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:12.046798 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 861/1715] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:12.056489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9523a3-be0d-494a-8892-099e604c3b7d None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.056671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9523a3-be0d-494a-8892-099e604c3b7d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.056945 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9523a3-be0d-494a-8892-099e604c3b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.140048 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-fb9523a3-be0d-494a-8892-099e604c3b7d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:12.145277 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fb9523a3-be0d-494a-8892-099e604c3b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:12.170443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 862/1716] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:12.171495 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9523a3-be0d-494a-8892-099e604c3b7d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:12.175186 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fb9523a3-be0d-494a-8892-099e604c3b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:12.193255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4ffa4-fc88-47b7-8c31-f73e1d0ea5d5 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:12.201615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33205528-1b1b-4069-aba3-7f81898c8ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:12.202613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33205528-1b1b-4069-aba3-7f81898c8ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.203040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33205528-1b1b-4069-aba3-7f81898c8ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.203525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33205528-1b1b-4069-aba3-7f81898c8ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.204567 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9523a3-be0d-494a-8892-099e604c3b7d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:12.215929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33205528-1b1b-4069-aba3-7f81898c8ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:12.225031 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33205528-1b1b-4069-aba3-7f81898c8ca5 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:12.230631 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:12.231695 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.231987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.232264 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] PATH_INFO: `/v3/users/e1ddbbbfd9c340c8b40715c103c8fef7` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.239325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 855/1717] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:12.240644 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ddbbbfd9c340c8b40715c103c8fef7)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:12.241403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33205528-1b1b-4069-aba3-7f81898c8ca5 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:12.243503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:12.253670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33205528-1b1b-4069-aba3-7f81898c8ca5 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:12.266017 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431428a1-25f6-4125-857e-e7008e9b9d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:12.268136 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431428a1-25f6-4125-857e-e7008e9b9d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.269825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431428a1-25f6-4125-857e-e7008e9b9d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.270287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431428a1-25f6-4125-857e-e7008e9b9d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.271281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431428a1-25f6-4125-857e-e7008e9b9d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:12.273006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431428a1-25f6-4125-857e-e7008e9b9d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:12.278406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431428a1-25f6-4125-857e-e7008e9b9d26 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:12.322449 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 856/1718] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:12.345806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431428a1-25f6-4125-857e-e7008e9b9d26 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:12.372906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ddbbbfd9c340c8b40715c103c8fef7'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:12.373839 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431428a1-25f6-4125-857e-e7008e9b9d26 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:12.389230 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0f74f-09d8-4261-92a6-8237fcdc61be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:12.390189 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f74f-09d8-4261-92a6-8237fcdc61be admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.390757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f74f-09d8-4261-92a6-8237fcdc61be admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.391106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f74f-09d8-4261-92a6-8237fcdc61be admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.391994 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0f74f-09d8-4261-92a6-8237fcdc61be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:12.395283 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0f74f-09d8-4261-92a6-8237fcdc61be admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:12.407283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ddbbbfd9c340c8b40715c103c8fef7'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:12.431150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ddbbbfd9c340c8b40715c103c8fef7'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:12.432217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ddbbbfd9c340c8b40715c103c8fef7'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:12.444554 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ddbbbfd9c340c8b40715c103c8fef7'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:12.460373 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 857/1719] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:12 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:12.460373 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0f74f-09d8-4261-92a6-8237fcdc61be admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:12.460646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 863/1720] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:12 2022] DELETE /identity/v3/users/e1ddbbbfd9c340c8b40715c103c8fef7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:12.461644 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:12.463447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:12.464961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-35b0f74f-09d8-4261-92a6-8237fcdc61be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:12.570427 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabeb12-3d98-4aa0-bae6-a63a55c64b00 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:12.581971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f74b2-60f1-496e-9ad1-d10c8b56e5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:12.581971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f74b2-60f1-496e-9ad1-d10c8b56e5cc admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.581971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f74b2-60f1-496e-9ad1-d10c8b56e5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.581971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f74b2-60f1-496e-9ad1-d10c8b56e5cc admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.596771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f74b2-60f1-496e-9ad1-d10c8b56e5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:12.602737 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f74b2-60f1-496e-9ad1-d10c8b56e5cc admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:12.614878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0f74f-09d8-4261-92a6-8237fcdc61be admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:12.666107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 864/1721] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:12 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:12.668161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2951a71-d858-429b-8dc0-1d36fa004020 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.670549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2951a71-d858-429b-8dc0-1d36fa004020 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.670838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2951a71-d858-429b-8dc0-1d36fa004020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.704325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a2951a71-d858-429b-8dc0-1d36fa004020 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:12.705518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a2951a71-d858-429b-8dc0-1d36fa004020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:12.721818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 865/1722] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:12.724640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a103ab5-2a9b-4065-8743-42015f940e80 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.724913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a103ab5-2a9b-4065-8743-42015f940e80 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.725187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a103ab5-2a9b-4065-8743-42015f940e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.731687 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159dea9-ab99-43b1-97a3-6c223fb6525f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:12.732364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159dea9-ab99-43b1-97a3-6c223fb6525f service swift] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.732635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159dea9-ab99-43b1-97a3-6c223fb6525f service swift] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.733005 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159dea9-ab99-43b1-97a3-6c223fb6525f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.736965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-7159dea9-ab99-43b1-97a3-6c223fb6525f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:12.785142 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-8a103ab5-2a9b-4065-8743-42015f940e80 None None] MFA Rules not processed for user `bb244d01a3c34f409b52f9625be7de57`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:12.786371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8a103ab5-2a9b-4065-8743-42015f940e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:12.857560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159dea9-ab99-43b1-97a3-6c223fb6525f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:12.861075 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159dea9-ab99-43b1-97a3-6c223fb6525f service swift] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:12.913328 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 858/1723] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:38:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:38:12.923648 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159dea9-ab99-43b1-97a3-6c223fb6525f service swift] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:12.955372 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159dea9-ab99-43b1-97a3-6c223fb6525f service swift] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:12.984229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e631ab-df9e-4b33-9132-5b6dadb08ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:12.985340 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e631ab-df9e-4b33-9132-5b6dadb08ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.985825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e631ab-df9e-4b33-9132-5b6dadb08ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.986107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e631ab-df9e-4b33-9132-5b6dadb08ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.986875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e631ab-df9e-4b33-9132-5b6dadb08ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:12.988505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e631ab-df9e-4b33-9132-5b6dadb08ec9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.009438 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 866/1724] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:13.010922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a103ab5-2a9b-4065-8743-42015f940e80 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:13.011872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 859/1725] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:13.012830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8a103ab5-2a9b-4065-8743-42015f940e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:13.015057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e631ab-df9e-4b33-9132-5b6dadb08ec9 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:13.018318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-33e631ab-df9e-4b33-9132-5b6dadb08ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:13.049421 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e631ab-df9e-4b33-9132-5b6dadb08ec9 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:13.061784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:13.062910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.063201 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.063482 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] PATH_INFO: `/v3/projects/5a4573668eef49469fbca151c489dd3c` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.066186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4573668eef49469fbca151c489dd3c)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:13.072127 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.147385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a103ab5-2a9b-4065-8743-42015f940e80 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:13.165982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573189c-2739-4d47-8a96-c99053ad285b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:13.167120 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573189c-2739-4d47-8a96-c99053ad285b service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.167575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573189c-2739-4d47-8a96-c99053ad285b service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.167951 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573189c-2739-4d47-8a96-c99053ad285b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.186166 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573189c-2739-4d47-8a96-c99053ad285b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:13.188206 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573189c-2739-4d47-8a96-c99053ad285b service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.202786 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4573668eef49469fbca151c489dd3c', 'request_id': 'req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:13.213912 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4573668eef49469fbca151c489dd3c', 'request_id': 'req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:13.224029 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 867/1726] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:13.227889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69afcc0-a5ca-41ca-bf49-3e6a324aa014 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.229280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69afcc0-a5ca-41ca-bf49-3e6a324aa014 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.229706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69afcc0-a5ca-41ca-bf49-3e6a324aa014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.233285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4573668eef49469fbca151c489dd3c', 'request_id': 'req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:13.251264 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] The token cache is being invalidate because project 5a4573668eef49469fbca151c489dd3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:13.251653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:13.254674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:13.260416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 860/1727] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:13 2022] DELETE /identity/v3/projects/5a4573668eef49469fbca151c489dd3c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:13.260416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:13.260416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:13.283581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b69afcc0-a5ca-41ca-bf49-3e6a324aa014 None None] MFA Rules not processed for user `faac09d2bacd4759ada261c83b83362e`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:13.285144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b69afcc0-a5ca-41ca-bf49-3e6a324aa014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:13.443508 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 868/1728] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:13.444451 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69afcc0-a5ca-41ca-bf49-3e6a324aa014 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:13.459492 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b69afcc0-a5ca-41ca-bf49-3e6a324aa014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:13.591660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a52d29-29e9-4877-b7f8-2fb1eeeb3e04 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:13.607043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452cd43-7806-4303-af13-7c3d76b0ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:13.608247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452cd43-7806-4303-af13-7c3d76b0ee02 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.608795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452cd43-7806-4303-af13-7c3d76b0ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.609286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452cd43-7806-4303-af13-7c3d76b0ee02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.612623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452cd43-7806-4303-af13-7c3d76b0ee02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:13.621071 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452cd43-7806-4303-af13-7c3d76b0ee02 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.677908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 861/1729] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:13.680796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3fc1b-298f-4c0c-ae91-338341605098 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.685996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3fc1b-298f-4c0c-ae91-338341605098 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.686416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3fc1b-298f-4c0c-ae91-338341605098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.727588 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69afcc0-a5ca-41ca-bf49-3e6a324aa014 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:13.755200 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02986c41-eab8-4ad3-a162-57396c6ca9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:13.755647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0af3fc1b-298f-4c0c-ae91-338341605098 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:13.761692 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02986c41-eab8-4ad3-a162-57396c6ca9ed admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.762577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02986c41-eab8-4ad3-a162-57396c6ca9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.769274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0af3fc1b-298f-4c0c-ae91-338341605098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:13.779915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02986c41-eab8-4ad3-a162-57396c6ca9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.781975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02986c41-eab8-4ad3-a162-57396c6ca9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:13.788562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02986c41-eab8-4ad3-a162-57396c6ca9ed admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.808252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 862/1730] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:13.812318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3fc1b-298f-4c0c-ae91-338341605098 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:13.844645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3fc1b-298f-4c0c-ae91-338341605098 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:13.879359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ada74-ee2a-4b34-8e9a-261815b2011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:13.880277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ada74-ee2a-4b34-8e9a-261815b2011a admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.880564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ada74-ee2a-4b34-8e9a-261815b2011a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.880938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ada74-ee2a-4b34-8e9a-261815b2011a admin admin] PATH_INFO: `/v3/projects/de2f5bd96f2a479dae04b998ac1e5350/users/64cb5d3d39f744099c4bd7bf5a7d1f28/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.885398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 869/1731] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:13 2022] POST /identity/v3/projects => generated 405 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:13.891576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d88fb-aa75-489d-94c7-82b43e5cdae8 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.892214 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d88fb-aa75-489d-94c7-82b43e5cdae8 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.892964 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d88fb-aa75-489d-94c7-82b43e5cdae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.949441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ada74-ee2a-4b34-8e9a-261815b2011a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2f5bd96f2a479dae04b998ac1e5350, user_id=64cb5d3d39f744099c4bd7bf5a7d1f28, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:13.952382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ada74-ee2a-4b34-8e9a-261815b2011a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.957414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-d78d88fb-aa75-489d-94c7-82b43e5cdae8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:13.959031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-d78d88fb-aa75-489d-94c7-82b43e5cdae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:14.001609 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 863/1732] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:13 2022] PUT /identity/v3/projects/de2f5bd96f2a479dae04b998ac1e5350/users/64cb5d3d39f744099c4bd7bf5a7d1f28/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:14.002545 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ada74-ee2a-4b34-8e9a-261815b2011a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:14.119820 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 870/1733] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:14.121852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf74566-e673-473e-acd2-c71d04502b61 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:14.122434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf74566-e673-473e-acd2-c71d04502b61 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:14.123447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf74566-e673-473e-acd2-c71d04502b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:14.220948 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ada74-ee2a-4b34-8e9a-261815b2011a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:14.249110 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf207f3-2914-4e81-9b4a-3339ed06bf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:14.252640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf207f3-2914-4e81-9b4a-3339ed06bf1a admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:14.254007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf207f3-2914-4e81-9b4a-3339ed06bf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:14.255748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf207f3-2914-4e81-9b4a-3339ed06bf1a admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:14.256677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf207f3-2914-4e81-9b4a-3339ed06bf1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:14.264346 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf207f3-2914-4e81-9b4a-3339ed06bf1a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:14.319810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-aaf74566-e673-473e-acd2-c71d04502b61 None None] MFA Rules not processed for user `64cb5d3d39f744099c4bd7bf5a7d1f28`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:14.321434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-aaf74566-e673-473e-acd2-c71d04502b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:14.330307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 864/1734] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:14 2022] POST /identity/v3/users => generated 309 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:14.331433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf207f3-2914-4e81-9b4a-3339ed06bf1a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:14.368399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf207f3-2914-4e81-9b4a-3339ed06bf1a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:14.388102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b99e5-2efb-41b9-b307-d64bfa0fde49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:14.389959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b99e5-2efb-41b9-b307-d64bfa0fde49 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:14.391667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b99e5-2efb-41b9-b307-d64bfa0fde49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:14.392114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b99e5-2efb-41b9-b307-d64bfa0fde49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:14.393001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b99e5-2efb-41b9-b307-d64bfa0fde49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:14.395075 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b99e5-2efb-41b9-b307-d64bfa0fde49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:14.399093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b99e5-2efb-41b9-b307-d64bfa0fde49 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:14.432667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 865/1735] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:14.434641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b99e5-2efb-41b9-b307-d64bfa0fde49 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:14.457897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b99e5-2efb-41b9-b307-d64bfa0fde49 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:14.464538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2a872-2bd4-47e0-a147-747cdab842cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:14.466089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2a872-2bd4-47e0-a147-747cdab842cf admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:14.466250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2a872-2bd4-47e0-a147-747cdab842cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:14.467422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2a872-2bd4-47e0-a147-747cdab842cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:14.467678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2a872-2bd4-47e0-a147-747cdab842cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:14.470687 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2a872-2bd4-47e0-a147-747cdab842cf admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:14.485407 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 866/1736] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:14.486332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2a872-2bd4-47e0-a147-747cdab842cf admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:14.497533 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2a872-2bd4-47e0-a147-747cdab842cf admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:14.506343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481db28e-eaba-4c86-9a64-b52dcae2b4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:14.507389 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481db28e-eaba-4c86-9a64-b52dcae2b4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:14.508699 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481db28e-eaba-4c86-9a64-b52dcae2b4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:14.508890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481db28e-eaba-4c86-9a64-b52dcae2b4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:14.510725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481db28e-eaba-4c86-9a64-b52dcae2b4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:14.512957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481db28e-eaba-4c86-9a64-b52dcae2b4e8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:14.568172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 867/1737] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:14 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:14.569058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481db28e-eaba-4c86-9a64-b52dcae2b4e8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:14.571902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 871/1738] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:14.572402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf74566-e673-473e-acd2-c71d04502b61 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:14.577104 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-481db28e-eaba-4c86-9a64-b52dcae2b4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:14.606578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf74566-e673-473e-acd2-c71d04502b61 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:14.772420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481db28e-eaba-4c86-9a64-b52dcae2b4e8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:14.785421 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:14.786564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:14.787245 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:14.787728 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] PATH_INFO: `/v3/projects/4f5d9729c5f34168b47c9e85ad329caa` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:14.801981 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f5d9729c5f34168b47c9e85ad329caa)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:14.802612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1e49d-7c94-4851-86e9-ee11c6dc31cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:14.803511 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1e49d-7c94-4851-86e9-ee11c6dc31cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:14.803791 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1e49d-7c94-4851-86e9-ee11c6dc31cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:14.804326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1e49d-7c94-4851-86e9-ee11c6dc31cf admin admin] PATH_INFO: `/v3/projects/3c65c4a8b9204043b33a85d8fa6929b7/users/b5f341d7178b482a8285be27c1282587/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:14.808955 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:14.858638 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1e49d-7c94-4851-86e9-ee11c6dc31cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c65c4a8b9204043b33a85d8fa6929b7, user_id=b5f341d7178b482a8285be27c1282587, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:14.863239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1e49d-7c94-4851-86e9-ee11c6dc31cf admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:14.892055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 872/1739] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:14 2022] PUT /identity/v3/projects/3c65c4a8b9204043b33a85d8fa6929b7/users/b5f341d7178b482a8285be27c1282587/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:14.892575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1e49d-7c94-4851-86e9-ee11c6dc31cf admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:14.924011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f5d9729c5f34168b47c9e85ad329caa', 'request_id': 'req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:14.938669 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f5d9729c5f34168b47c9e85ad329caa', 'request_id': 'req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:14.957531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f5d9729c5f34168b47c9e85ad329caa', 'request_id': 'req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:14.978606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] The token cache is being invalidate because project 4f5d9729c5f34168b47c9e85ad329caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:14.979444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:14.980657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:14.982704 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 868/1740] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:14 2022] DELETE /identity/v3/projects/4f5d9729c5f34168b47c9e85ad329caa => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:14.983916 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:14.988484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:15.005567 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1e49d-7c94-4851-86e9-ee11c6dc31cf admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:15.114978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e7624-3d84-4878-b731-749a3891492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:15.115719 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e7624-3d84-4878-b731-749a3891492a admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.115991 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e7624-3d84-4878-b731-749a3891492a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.116362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e7624-3d84-4878-b731-749a3891492a admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.117540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e7624-3d84-4878-b731-749a3891492a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:15.123630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e7624-3d84-4878-b731-749a3891492a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:15.143152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a01dc-d092-4dea-b1cc-d9de893ee5a5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:15.159716 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877d8b-02c2-4459-bd0c-5a4807d20282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:15.160528 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877d8b-02c2-4459-bd0c-5a4807d20282 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.160814 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877d8b-02c2-4459-bd0c-5a4807d20282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.161090 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877d8b-02c2-4459-bd0c-5a4807d20282 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.161827 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52877d8b-02c2-4459-bd0c-5a4807d20282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:15.163860 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52877d8b-02c2-4459-bd0c-5a4807d20282 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:15.182806 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 873/1741] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:14 2022] POST /identity/v3/projects => generated 387 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:15.190675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e7624-3d84-4878-b731-749a3891492a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:15.192994 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-cd0e7624-3d84-4878-b731-749a3891492a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:15.218661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 869/1742] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:14 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:15.218661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9006a-b165-4dd4-88da-988680c96aaa None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.218661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9006a-b165-4dd4-88da-988680c96aaa None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.218661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9006a-b165-4dd4-88da-988680c96aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.245472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e3d9006a-b165-4dd4-88da-988680c96aaa None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:15.246916 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e3d9006a-b165-4dd4-88da-988680c96aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:15.299952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e7624-3d84-4878-b731-749a3891492a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:15.306406 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7610d-5487-41c6-861b-d3b4067bc552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:15.307098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7610d-5487-41c6-861b-d3b4067bc552 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.315188 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7610d-5487-41c6-861b-d3b4067bc552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.315492 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7610d-5487-41c6-861b-d3b4067bc552 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.316287 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7610d-5487-41c6-861b-d3b4067bc552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:15.318473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7610d-5487-41c6-861b-d3b4067bc552 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:15.330058 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 874/1743] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:15.331613 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f55c4-dc0a-4ee2-9da4-6fe0b4b01d26 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.331863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f55c4-dc0a-4ee2-9da4-6fe0b4b01d26 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.332160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f55c4-dc0a-4ee2-9da4-6fe0b4b01d26 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.334155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 875/1744] 10.222.0.79 () {54 vars in 912 bytes} [Mon Feb 21 01:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:38:15.335227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f55c4-dc0a-4ee2-9da4-6fe0b4b01d26 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:15.337660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-724f55c4-dc0a-4ee2-9da4-6fe0b4b01d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:15.350298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 870/1745] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:15.352111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9006a-b165-4dd4-88da-988680c96aaa None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:15.356129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f55c4-dc0a-4ee2-9da4-6fe0b4b01d26 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:15.363055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6f243-2d1c-498c-98ef-8ec45d033999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:15.364322 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6f243-2d1c-498c-98ef-8ec45d033999 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.364714 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6f243-2d1c-498c-98ef-8ec45d033999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.366127 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9006a-b165-4dd4-88da-988680c96aaa None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:15.366665 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6f243-2d1c-498c-98ef-8ec45d033999 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.367807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6f243-2d1c-498c-98ef-8ec45d033999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:15.370593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6f243-2d1c-498c-98ef-8ec45d033999 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:15.372609 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee435947-2f34-4a2f-b604-7bcf5b8ef3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:15.373469 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435947-2f34-4a2f-b604-7bcf5b8ef3de admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.373920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435947-2f34-4a2f-b604-7bcf5b8ef3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.374512 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435947-2f34-4a2f-b604-7bcf5b8ef3de admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.375937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee435947-2f34-4a2f-b604-7bcf5b8ef3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:15.377706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee435947-2f34-4a2f-b604-7bcf5b8ef3de admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:15.390133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 871/1746] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:15.391332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee435947-2f34-4a2f-b604-7bcf5b8ef3de admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:15.408301 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 876/1747] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:15 2022] POST /identity/v3/users => generated 300 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:15.421336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10260837-74ce-45e5-a0ac-1afbc69dbec6 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.421772 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10260837-74ce-45e5-a0ac-1afbc69dbec6 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.423749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10260837-74ce-45e5-a0ac-1afbc69dbec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.432800 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee435947-2f34-4a2f-b604-7bcf5b8ef3de admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:15.444643 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bbd6a-d587-4049-b24c-f255bb3913e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:15.445948 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bbd6a-d587-4049-b24c-f255bb3913e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.446059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bbd6a-d587-4049-b24c-f255bb3913e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.451930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bbd6a-d587-4049-b24c-f255bb3913e0 admin admin] PATH_INFO: `/v3/projects/3c65c4a8b9204043b33a85d8fa6929b7/users/b5f341d7178b482a8285be27c1282587/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.455641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bbd6a-d587-4049-b24c-f255bb3913e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c65c4a8b9204043b33a85d8fa6929b7, user_id=b5f341d7178b482a8285be27c1282587, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:15.458781 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bbd6a-d587-4049-b24c-f255bb3913e0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:15.467501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-10260837-74ce-45e5-a0ac-1afbc69dbec6 None None] MFA Rules not processed for user `3f00b174c88547e2ab799d89a50d5b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:15.469236 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-10260837-74ce-45e5-a0ac-1afbc69dbec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:15.484809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 872/1748] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:15 2022] PUT /identity/v3/projects/3c65c4a8b9204043b33a85d8fa6929b7/users/b5f341d7178b482a8285be27c1282587/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:15.488146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e0ee-1c2f-4045-906a-fc6b89886a89 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.488579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e0ee-1c2f-4045-906a-fc6b89886a89 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.491088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e0ee-1c2f-4045-906a-fc6b89886a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.526988 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-fb99e0ee-1c2f-4045-906a-fc6b89886a89 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:15.528596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-fb99e0ee-1c2f-4045-906a-fc6b89886a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:15.593490 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 877/1749] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:15.594897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10260837-74ce-45e5-a0ac-1afbc69dbec6 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:15.696782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 873/1750] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:15.700476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99e0ee-1c2f-4045-906a-fc6b89886a89 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:15.729378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99e0ee-1c2f-4045-906a-fc6b89886a89 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:15.744015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661f47d-f87d-46a1-8d21-518242af2d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:15.746335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661f47d-f87d-46a1-8d21-518242af2d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.746649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661f47d-f87d-46a1-8d21-518242af2d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.747128 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661f47d-f87d-46a1-8d21-518242af2d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.747894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661f47d-f87d-46a1-8d21-518242af2d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:15.755039 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661f47d-f87d-46a1-8d21-518242af2d8e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:15.780218 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 874/1751] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:15.781070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661f47d-f87d-46a1-8d21-518242af2d8e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:15.788042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-1661f47d-f87d-46a1-8d21-518242af2d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:15.817960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10260837-74ce-45e5-a0ac-1afbc69dbec6 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:15.820956 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661f47d-f87d-46a1-8d21-518242af2d8e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:15.829950 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6f1a0-3870-48a0-9b1f-5d5c41361ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:15.830663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6f1a0-3870-48a0-9b1f-5d5c41361ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.832808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6f1a0-3870-48a0-9b1f-5d5c41361ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.833150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6f1a0-3870-48a0-9b1f-5d5c41361ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.840178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179464a-e211-4b7a-ac5a-ccb5b3531e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:15.841393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179464a-e211-4b7a-ac5a-ccb5b3531e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.844195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179464a-e211-4b7a-ac5a-ccb5b3531e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.844757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179464a-e211-4b7a-ac5a-ccb5b3531e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.848799 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179464a-e211-4b7a-ac5a-ccb5b3531e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:15.855283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179464a-e211-4b7a-ac5a-ccb5b3531e4e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:15.856875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6f1a0-3870-48a0-9b1f-5d5c41361ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:15.858599 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6f1a0-3870-48a0-9b1f-5d5c41361ac8 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:15.874618 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 878/1752] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:15.875868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179464a-e211-4b7a-ac5a-ccb5b3531e4e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:15.878360 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 875/1753] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:15.891501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179464a-e211-4b7a-ac5a-ccb5b3531e4e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:15.894457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982fcf1-977b-421f-b1a4-d5a4a38d864f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.895834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982fcf1-977b-421f-b1a4-d5a4a38d864f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.896475 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982fcf1-977b-421f-b1a4-d5a4a38d864f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.898456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb901d7e-b8f3-423b-b31c-58b143190bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:15.899522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb901d7e-b8f3-423b-b31c-58b143190bbb admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.899936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb901d7e-b8f3-423b-b31c-58b143190bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.900513 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb901d7e-b8f3-423b-b31c-58b143190bbb admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.901305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb901d7e-b8f3-423b-b31c-58b143190bbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:15.901998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb901d7e-b8f3-423b-b31c-58b143190bbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:15.903702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb901d7e-b8f3-423b-b31c-58b143190bbb admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:15.928273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 879/1754] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:15.929261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb901d7e-b8f3-423b-b31c-58b143190bbb admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:15.943217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb901d7e-b8f3-423b-b31c-58b143190bbb admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:15.949654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeebbf0-8833-414f-b176-3f19c968ea05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:15.950720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeebbf0-8833-414f-b176-3f19c968ea05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:15.951005 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeebbf0-8833-414f-b176-3f19c968ea05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:15.951284 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeebbf0-8833-414f-b176-3f19c968ea05 admin admin] PATH_INFO: `/v3/projects/0be5c0a1e97f4be48c184b2635b11696/users/9c995e37272c4310a981a6fc963392e0/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:15.972110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeebbf0-8833-414f-b176-3f19c968ea05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be5c0a1e97f4be48c184b2635b11696, user_id=9c995e37272c4310a981a6fc963392e0, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:15.972331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4982fcf1-977b-421f-b1a4-d5a4a38d864f None None] MFA Rules not processed for user `3f00b174c88547e2ab799d89a50d5b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:15.973551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4982fcf1-977b-421f-b1a4-d5a4a38d864f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:15.975721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeebbf0-8833-414f-b176-3f19c968ea05 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:15.982884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 876/1755] 10.222.0.73 () {58 vars in 1015 bytes} [Mon Feb 21 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:15.983151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982fcf1-977b-421f-b1a4-d5a4a38d864f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:16.000906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 880/1756] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:15 2022] PUT /identity/v3/projects/0be5c0a1e97f4be48c184b2635b11696/users/9c995e37272c4310a981a6fc963392e0/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:16.001756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeebbf0-8833-414f-b176-3f19c968ea05 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:16.030573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982fcf1-977b-421f-b1a4-d5a4a38d864f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:16.147693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeebbf0-8833-414f-b176-3f19c968ea05 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:16.154977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffa417-3464-47e4-a501-495553d9acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:16.155877 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffa417-3464-47e4-a501-495553d9acef admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:16.156239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffa417-3464-47e4-a501-495553d9acef admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:16.156627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffa417-3464-47e4-a501-495553d9acef admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:16.157439 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffa417-3464-47e4-a501-495553d9acef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:16.160549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffa417-3464-47e4-a501-495553d9acef admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:16.167824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41d782-7526-4678-ac57-77dd991dde71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:16.169795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41d782-7526-4678-ac57-77dd991dde71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:16.170438 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41d782-7526-4678-ac57-77dd991dde71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:16.171092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41d782-7526-4678-ac57-77dd991dde71 admin admin] PATH_INFO: `/v3/projects/4bff7bcbc47346149ba078443d06c80d/users/87dfb858cd7c450faa19405aa4f1ecf1/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:16.199401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41d782-7526-4678-ac57-77dd991dde71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bff7bcbc47346149ba078443d06c80d, user_id=87dfb858cd7c450faa19405aa4f1ecf1, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:16.204029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41d782-7526-4678-ac57-77dd991dde71 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:16.252288 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 881/1757] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:16 2022] POST /identity/v3/projects => generated 363 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:16.253475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffa417-3464-47e4-a501-495553d9acef admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:16.270717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 877/1758] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:15 2022] PUT /identity/v3/projects/4bff7bcbc47346149ba078443d06c80d/users/87dfb858cd7c450faa19405aa4f1ecf1/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:16.273831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41d782-7526-4678-ac57-77dd991dde71 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:16.283167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3c41d782-7526-4678-ac57-77dd991dde71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:16.452371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffa417-3464-47e4-a501-495553d9acef admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:16.465904 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487389c-a3d5-4962-ab47-b978a21cccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:16.467084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487389c-a3d5-4962-ab47-b978a21cccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:16.468356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487389c-a3d5-4962-ab47-b978a21cccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:16.468912 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487389c-a3d5-4962-ab47-b978a21cccd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:16.469879 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487389c-a3d5-4962-ab47-b978a21cccd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:16.472160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487389c-a3d5-4962-ab47-b978a21cccd1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:16.500080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 882/1759] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:16.501241 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487389c-a3d5-4962-ab47-b978a21cccd1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:16.516712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487389c-a3d5-4962-ab47-b978a21cccd1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:16.535888 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41d782-7526-4678-ac57-77dd991dde71 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:16.536420 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9057bf-0760-4272-9b7f-870cbae2084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:16.537394 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9057bf-0760-4272-9b7f-870cbae2084c admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:16.538128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9057bf-0760-4272-9b7f-870cbae2084c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:16.539532 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9057bf-0760-4272-9b7f-870cbae2084c admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:16.540526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9057bf-0760-4272-9b7f-870cbae2084c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:16.545180 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9057bf-0760-4272-9b7f-870cbae2084c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:16.608659 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 883/1760] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:16 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:16.611464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34193-a066-4f9c-8b04-ae29ebe6881d None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:16.611998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34193-a066-4f9c-8b04-ae29ebe6881d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:16.613837 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34193-a066-4f9c-8b04-ae29ebe6881d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:16.762173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-f2d34193-a066-4f9c-8b04-ae29ebe6881d None None] MFA Rules not processed for user `87dfb858cd7c450faa19405aa4f1ecf1`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:16.771118 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f2d34193-a066-4f9c-8b04-ae29ebe6881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:16.805112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1142986-461a-4699-901c-3854cc9a1e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:16.805112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1142986-461a-4699-901c-3854cc9a1e23 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:16.805112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1142986-461a-4699-901c-3854cc9a1e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:16.810674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1142986-461a-4699-901c-3854cc9a1e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:16.850436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1142986-461a-4699-901c-3854cc9a1e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:16.874916 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1142986-461a-4699-901c-3854cc9a1e23 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:16.921204 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 878/1761] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:16.931200 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1142986-461a-4699-901c-3854cc9a1e23 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:16.996122 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1142986-461a-4699-901c-3854cc9a1e23 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:17.039840 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec8d43-77ca-4b78-a8a5-2082900cc941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:17.042681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec8d43-77ca-4b78-a8a5-2082900cc941 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:17.043088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec8d43-77ca-4b78-a8a5-2082900cc941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:17.043467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec8d43-77ca-4b78-a8a5-2082900cc941 admin admin] PATH_INFO: `/v3/projects/0be5c0a1e97f4be48c184b2635b11696/users/9c995e37272c4310a981a6fc963392e0/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:17.050625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec8d43-77ca-4b78-a8a5-2082900cc941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be5c0a1e97f4be48c184b2635b11696, user_id=9c995e37272c4310a981a6fc963392e0, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:17.057510 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec8d43-77ca-4b78-a8a5-2082900cc941 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:17.121068 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 884/1762] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:17.122939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d34193-a066-4f9c-8b04-ae29ebe6881d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:17.151180 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d34193-a066-4f9c-8b04-ae29ebe6881d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:17.152390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 879/1763] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:16 2022] PUT /identity/v3/projects/0be5c0a1e97f4be48c184b2635b11696/users/9c995e37272c4310a981a6fc963392e0/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:17.153043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec8d43-77ca-4b78-a8a5-2082900cc941 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:17.164888 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-26ec8d43-77ca-4b78-a8a5-2082900cc941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:17.313547 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec8d43-77ca-4b78-a8a5-2082900cc941 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:17.324616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070e15f-9c3c-413a-b416-7769dc9aee67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:17.332676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e15f-9c3c-413a-b416-7769dc9aee67 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:17.332969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e15f-9c3c-413a-b416-7769dc9aee67 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:17.333524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e15f-9c3c-413a-b416-7769dc9aee67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:17.378282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b7313-558d-472f-be5a-8fa8ecdbbd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:17.387336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b7313-558d-472f-be5a-8fa8ecdbbd7c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:17.387838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b7313-558d-472f-be5a-8fa8ecdbbd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:17.388411 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b7313-558d-472f-be5a-8fa8ecdbbd7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:17.390389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b7313-558d-472f-be5a-8fa8ecdbbd7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:17.401829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b7313-558d-472f-be5a-8fa8ecdbbd7c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:17.453506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 885/1764] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:17.456869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada2bbe-5659-4e05-af8a-3a7e65d17954 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:17.457290 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada2bbe-5659-4e05-af8a-3a7e65d17954 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:17.457805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada2bbe-5659-4e05-af8a-3a7e65d17954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:17.506789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-8ada2bbe-5659-4e05-af8a-3a7e65d17954 None None] MFA Rules not processed for user `9c995e37272c4310a981a6fc963392e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:17.510873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8ada2bbe-5659-4e05-af8a-3a7e65d17954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:17.511033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070e15f-9c3c-413a-b416-7769dc9aee67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:17.517063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070e15f-9c3c-413a-b416-7769dc9aee67 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:17.550407 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 880/1765] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:17.551237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070e15f-9c3c-413a-b416-7769dc9aee67 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:17.579883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070e15f-9c3c-413a-b416-7769dc9aee67 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:17.592215 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf550985-f9f4-4dbf-b3a5-cbc7291170c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:17.592902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf550985-f9f4-4dbf-b3a5-cbc7291170c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:17.593189 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf550985-f9f4-4dbf-b3a5-cbc7291170c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:17.593468 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf550985-f9f4-4dbf-b3a5-cbc7291170c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:17.594235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf550985-f9f4-4dbf-b3a5-cbc7291170c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:17.596073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf550985-f9f4-4dbf-b3a5-cbc7291170c2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:17.610262 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 881/1766] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:17.613369 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf550985-f9f4-4dbf-b3a5-cbc7291170c2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:17.637112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf550985-f9f4-4dbf-b3a5-cbc7291170c2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:17.656942 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c6518-fcdf-44e9-a4c7-a49fe8c3c2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:17.657993 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c6518-fcdf-44e9-a4c7-a49fe8c3c2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:17.659617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c6518-fcdf-44e9-a4c7-a49fe8c3c2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:17.660325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c6518-fcdf-44e9-a4c7-a49fe8c3c2a6 admin admin] PATH_INFO: `/v3/projects/021f3ee7c55940298c59920c1313fcac/users/5850127540564d809b7823fca6b9b5bf/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:17.706101 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c6518-fcdf-44e9-a4c7-a49fe8c3c2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021f3ee7c55940298c59920c1313fcac, user_id=5850127540564d809b7823fca6b9b5bf, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:17.710560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c6518-fcdf-44e9-a4c7-a49fe8c3c2a6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:17.747965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 886/1767] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:17.759175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 882/1768] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:17 2022] PUT /identity/v3/projects/021f3ee7c55940298c59920c1313fcac/users/5850127540564d809b7823fca6b9b5bf/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:17.760962 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada2bbe-5659-4e05-af8a-3a7e65d17954 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:17.775311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8ada2bbe-5659-4e05-af8a-3a7e65d17954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:17.778337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820f6ec-4ca7-401d-931d-5c0a5cc4ecad None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:17.778627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820f6ec-4ca7-401d-931d-5c0a5cc4ecad None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:17.778902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820f6ec-4ca7-401d-931d-5c0a5cc4ecad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:17.811337 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada2bbe-5659-4e05-af8a-3a7e65d17954 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:17.852937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f820f6ec-4ca7-401d-931d-5c0a5cc4ecad None None] MFA Rules not processed for user `5850127540564d809b7823fca6b9b5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:17.859145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f820f6ec-4ca7-401d-931d-5c0a5cc4ecad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:17.925470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41953aa2-e411-4551-9ab7-df3984669eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:17.926356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41953aa2-e411-4551-9ab7-df3984669eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:17.926921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41953aa2-e411-4551-9ab7-df3984669eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:17.929223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41953aa2-e411-4551-9ab7-df3984669eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:18.059440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 883/1769] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:18.060654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820f6ec-4ca7-401d-931d-5c0a5cc4ecad None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:18.094596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41953aa2-e411-4551-9ab7-df3984669eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:18.096394 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41953aa2-e411-4551-9ab7-df3984669eb4 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:18.113438 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 887/1770] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:18.303788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820f6ec-4ca7-401d-931d-5c0a5cc4ecad None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:18.317462 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacab712-5532-4c25-bac6-082b78594415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:18.318776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacab712-5532-4c25-bac6-082b78594415 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:18.319069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacab712-5532-4c25-bac6-082b78594415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:18.319345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacab712-5532-4c25-bac6-082b78594415 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:18.320658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacab712-5532-4c25-bac6-082b78594415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:18.332257 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3e9f5-fe4f-47a4-bc5a-e0ab70ae6c2e None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:18.332789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3e9f5-fe4f-47a4-bc5a-e0ab70ae6c2e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:18.333138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3e9f5-fe4f-47a4-bc5a-e0ab70ae6c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:18.335185 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacab712-5532-4c25-bac6-082b78594415 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:18.383206 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 884/1771] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:18 2022] POST /identity/v3/projects => generated 363 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:38:18.386860 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacab712-5532-4c25-bac6-082b78594415 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:18.420879 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c0a3e9f5-fe4f-47a4-bc5a-e0ab70ae6c2e None None] MFA Rules not processed for user `b5f341d7178b482a8285be27c1282587`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:18.425708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c0a3e9f5-fe4f-47a4-bc5a-e0ab70ae6c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:18.525125 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacab712-5532-4c25-bac6-082b78594415 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:18.530738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46e632-507b-431a-b8b1-57a70668cf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:18.531428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e632-507b-431a-b8b1-57a70668cf7c admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:18.531721 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e632-507b-431a-b8b1-57a70668cf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:18.532083 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e632-507b-431a-b8b1-57a70668cf7c admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:18.533077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46e632-507b-431a-b8b1-57a70668cf7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:18.535698 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46e632-507b-431a-b8b1-57a70668cf7c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:18.566749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 885/1772] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:18 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:18.571838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46e632-507b-431a-b8b1-57a70668cf7c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:18.573813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 888/1773] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:18.585530 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46e632-507b-431a-b8b1-57a70668cf7c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:18.597914 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdb5e7-ee81-4d34-aa6b-cb04a94942ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:18.599084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdb5e7-ee81-4d34-aa6b-cb04a94942ef admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:18.599628 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdb5e7-ee81-4d34-aa6b-cb04a94942ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:18.600594 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdb5e7-ee81-4d34-aa6b-cb04a94942ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:18.601504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdb5e7-ee81-4d34-aa6b-cb04a94942ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:18.603263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdb5e7-ee81-4d34-aa6b-cb04a94942ef admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:18.618948 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 886/1774] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:18.622932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3e9f5-fe4f-47a4-bc5a-e0ab70ae6c2e None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:18.673553 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3e9f5-fe4f-47a4-bc5a-e0ab70ae6c2e None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:18.680906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628bc6e-4d23-4592-bd66-fa0fac297644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:18.682370 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628bc6e-4d23-4592-bd66-fa0fac297644 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:18.683060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628bc6e-4d23-4592-bd66-fa0fac297644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:18.683489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628bc6e-4d23-4592-bd66-fa0fac297644 admin admin] PATH_INFO: `/v3/projects/84a87e5beda448d582adbeb71f6f1f83/users/3220e3e5e2a64dee97c53fa41556d98c/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:18.708960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628bc6e-4d23-4592-bd66-fa0fac297644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a87e5beda448d582adbeb71f6f1f83, user_id=3220e3e5e2a64dee97c53fa41556d98c, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:18.712939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628bc6e-4d23-4592-bd66-fa0fac297644 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:18.733986 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 889/1775] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:18 2022] PUT /identity/v3/projects/84a87e5beda448d582adbeb71f6f1f83/users/3220e3e5e2a64dee97c53fa41556d98c/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:18.737980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdb5e7-ee81-4d34-aa6b-cb04a94942ef admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:18.759791 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdb5e7-ee81-4d34-aa6b-cb04a94942ef admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:18.877403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8fe02-f233-45ff-b0ab-ed7da2517d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:18.878276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8fe02-f233-45ff-b0ab-ed7da2517d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:18.878726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8fe02-f233-45ff-b0ab-ed7da2517d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:18.879202 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8fe02-f233-45ff-b0ab-ed7da2517d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:18.888121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8fe02-f233-45ff-b0ab-ed7da2517d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:18.890652 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8fe02-f233-45ff-b0ab-ed7da2517d81 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:18.918921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 887/1776] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:18.920649 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628bc6e-4d23-4592-bd66-fa0fac297644 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:18.938273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628bc6e-4d23-4592-bd66-fa0fac297644 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:18.971506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af77e5c-68eb-44cc-b957-3d25bf8d34c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:18.972916 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af77e5c-68eb-44cc-b957-3d25bf8d34c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:18.977435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af77e5c-68eb-44cc-b957-3d25bf8d34c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:18.977989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af77e5c-68eb-44cc-b957-3d25bf8d34c2 admin admin] PATH_INFO: `/v3/projects/84a87e5beda448d582adbeb71f6f1f83/users/3220e3e5e2a64dee97c53fa41556d98c/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:18.980668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af77e5c-68eb-44cc-b957-3d25bf8d34c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a87e5beda448d582adbeb71f6f1f83, user_id=3220e3e5e2a64dee97c53fa41556d98c, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:18.988064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af77e5c-68eb-44cc-b957-3d25bf8d34c2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:19.028649 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 890/1777] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:18 2022] PUT /identity/v3/projects/84a87e5beda448d582adbeb71f6f1f83/users/3220e3e5e2a64dee97c53fa41556d98c/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:19.030342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d6397-e0bd-411d-ad1f-aa70874841c0 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:19.030729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d6397-e0bd-411d-ad1f-aa70874841c0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:19.031154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d6397-e0bd-411d-ad1f-aa70874841c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:19.099144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e77d6397-e0bd-411d-ad1f-aa70874841c0 None None] MFA Rules not processed for user `3220e3e5e2a64dee97c53fa41556d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:19.100370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e77d6397-e0bd-411d-ad1f-aa70874841c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:19.263333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 888/1778] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:19.274668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af77e5c-68eb-44cc-b957-3d25bf8d34c2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:19.372434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af77e5c-68eb-44cc-b957-3d25bf8d34c2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:19.378355 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67f1c7-0d94-4dc8-a664-f705a111f170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:19.378593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67f1c7-0d94-4dc8-a664-f705a111f170 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:19.379195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67f1c7-0d94-4dc8-a664-f705a111f170 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:19.379665 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67f1c7-0d94-4dc8-a664-f705a111f170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:19.390859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67f1c7-0d94-4dc8-a664-f705a111f170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:19.392578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67f1c7-0d94-4dc8-a664-f705a111f170 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:19.404324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 891/1779] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:19.454756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d6397-e0bd-411d-ad1f-aa70874841c0 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:19.588918 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d6397-e0bd-411d-ad1f-aa70874841c0 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:19.605629 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07109ca7-78db-4b92-9566-b3aa2897eb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:19.606075 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07109ca7-78db-4b92-9566-b3aa2897eb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:19.606453 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07109ca7-78db-4b92-9566-b3aa2897eb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:19.606797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07109ca7-78db-4b92-9566-b3aa2897eb6e admin admin] PATH_INFO: `/v3/users/64cb5d3d39f744099c4bd7bf5a7d1f28` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:19.608146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07109ca7-78db-4b92-9566-b3aa2897eb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=64cb5d3d39f744099c4bd7bf5a7d1f28)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:19.613153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07109ca7-78db-4b92-9566-b3aa2897eb6e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:19.729145 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67f1c7-0d94-4dc8-a664-f705a111f170 service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:19.746732 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67f1c7-0d94-4dc8-a664-f705a111f170 service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:19.753240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-07109ca7-78db-4b92-9566-b3aa2897eb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64cb5d3d39f744099c4bd7bf5a7d1f28'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:19.762300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-07109ca7-78db-4b92-9566-b3aa2897eb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64cb5d3d39f744099c4bd7bf5a7d1f28'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:19.762501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:19.763447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:19.763863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:19.764218 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] PATH_INFO: `/v3/users/5850127540564d809b7823fca6b9b5bf` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:19.766703 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5850127540564d809b7823fca6b9b5bf)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:19.775560 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:19.777853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-07109ca7-78db-4b92-9566-b3aa2897eb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64cb5d3d39f744099c4bd7bf5a7d1f28'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:19.778800 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-07109ca7-78db-4b92-9566-b3aa2897eb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64cb5d3d39f744099c4bd7bf5a7d1f28'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:19.779576 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-07109ca7-78db-4b92-9566-b3aa2897eb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64cb5d3d39f744099c4bd7bf5a7d1f28'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:19.799747 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 889/1780] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:19 2022] DELETE /identity/v3/users/64cb5d3d39f744099c4bd7bf5a7d1f28 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:19.801949 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25df938-0c4f-44ef-9835-f1f04984f535 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:19.802494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25df938-0c4f-44ef-9835-f1f04984f535 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:19.803045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25df938-0c4f-44ef-9835-f1f04984f535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:19.826764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-a25df938-0c4f-44ef-9835-f1f04984f535 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:19.828273 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a25df938-0c4f-44ef-9835-f1f04984f535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:19.871200 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5850127540564d809b7823fca6b9b5bf'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:19.884847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5850127540564d809b7823fca6b9b5bf'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:19.916587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5850127540564d809b7823fca6b9b5bf'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:19.917920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5850127540564d809b7823fca6b9b5bf'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:19.937477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5850127540564d809b7823fca6b9b5bf'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:19.938409 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 890/1781] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:19.940699 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa64d-7444-41c0-8847-f92f8f8f9ee7 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:19.941374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa64d-7444-41c0-8847-f92f8f8f9ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:19.941668 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa64d-7444-41c0-8847-f92f8f8f9ee7 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:19.945826 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 891/1782] 10.222.0.79 () {54 vars in 921 bytes} [Mon Feb 21 01:38:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:38:19.946408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 892/1783] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:19 2022] DELETE /identity/v3/users/5850127540564d809b7823fca6b9b5bf => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:19.951000 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcebff-b968-4d6c-91e6-0ac03b0b9f35 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:19.951319 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcebff-b968-4d6c-91e6-0ac03b0b9f35 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:19.951562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcebff-b968-4d6c-91e6-0ac03b0b9f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:19.955341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:19.957347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:19.986416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-8dfcebff-b968-4d6c-91e6-0ac03b0b9f35 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:19.987628 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8dfcebff-b968-4d6c-91e6-0ac03b0b9f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:20.041474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a03d2-4826-4763-acbb-66ed9cdd14d5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:20.051859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63a120-be06-4ed6-a865-95ebc3d73d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:20.052646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63a120-be06-4ed6-a865-95ebc3d73d8d service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:20.053079 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63a120-be06-4ed6-a865-95ebc3d73d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:20.053461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63a120-be06-4ed6-a865-95ebc3d73d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:20.089615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 892/1784] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:20.089615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acd50c-57ee-4f21-ba3f-37e9b4532e58 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:20.089615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acd50c-57ee-4f21-ba3f-37e9b4532e58 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:20.095552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acd50c-57ee-4f21-ba3f-37e9b4532e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:20.117453 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-b1acd50c-57ee-4f21-ba3f-37e9b4532e58 None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:20.119509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b1acd50c-57ee-4f21-ba3f-37e9b4532e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:20.149842 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63a120-be06-4ed6-a865-95ebc3d73d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:20.151536 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63a120-be06-4ed6-a865-95ebc3d73d8d service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:20.173769 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 893/1785] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:20.177813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63a120-be06-4ed6-a865-95ebc3d73d8d service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:20.196896 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63a120-be06-4ed6-a865-95ebc3d73d8d service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:20.202675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf939b2-b428-4e1f-8284-c7cdb86df756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:20.203865 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf939b2-b428-4e1f-8284-c7cdb86df756 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:20.204339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf939b2-b428-4e1f-8284-c7cdb86df756 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:20.204630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf939b2-b428-4e1f-8284-c7cdb86df756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:20.216588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 893/1786] 10.222.0.79 () {58 vars in 1018 bytes} [Mon Feb 21 01:38:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:20.216885 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf939b2-b428-4e1f-8284-c7cdb86df756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:20.218284 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf939b2-b428-4e1f-8284-c7cdb86df756 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:20.233712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 894/1787] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:20.255929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acd50c-57ee-4f21-ba3f-37e9b4532e58 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:20.258002 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b1acd50c-57ee-4f21-ba3f-37e9b4532e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:20.276085 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acd50c-57ee-4f21-ba3f-37e9b4532e58 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:20.283612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685331dc-f3fa-4042-a748-1b1b6693dbf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:20.284456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685331dc-f3fa-4042-a748-1b1b6693dbf9 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:20.285107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685331dc-f3fa-4042-a748-1b1b6693dbf9 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:20.285107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685331dc-f3fa-4042-a748-1b1b6693dbf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:20.294659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685331dc-f3fa-4042-a748-1b1b6693dbf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:20.296297 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685331dc-f3fa-4042-a748-1b1b6693dbf9 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:20.307473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 894/1788] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:20.981567 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf939b2-b428-4e1f-8284-c7cdb86df756 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:20.984039 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-abf939b2-b428-4e1f-8284-c7cdb86df756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:21.011493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf939b2-b428-4e1f-8284-c7cdb86df756 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:21.018744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685331dc-f3fa-4042-a748-1b1b6693dbf9 service nova] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:21.021593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-685331dc-f3fa-4042-a748-1b1b6693dbf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:21.029273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:21.030448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:21.032466 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:21.032909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] PATH_INFO: `/v3/projects/021f3ee7c55940298c59920c1313fcac` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:21.034727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] RBAC: Authorizing `identity:delete_project(project_id=021f3ee7c55940298c59920c1313fcac)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:21.037195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:21.060772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685331dc-f3fa-4042-a748-1b1b6693dbf9 service nova] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:21.067792 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:21.069068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:21.069488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:21.070667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] PATH_INFO: `/v3/projects/de2f5bd96f2a479dae04b998ac1e5350` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:21.080765 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2f5bd96f2a479dae04b998ac1e5350)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:21.083807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:21.145037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021f3ee7c55940298c59920c1313fcac', 'request_id': 'req-2410943d-63e9-4153-8f04-dd655f8e187d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.164233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021f3ee7c55940298c59920c1313fcac', 'request_id': 'req-2410943d-63e9-4153-8f04-dd655f8e187d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.170639 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2f5bd96f2a479dae04b998ac1e5350', 'request_id': 'req-969b5be1-9dda-454c-8735-e0a036e3dfa2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.181811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021f3ee7c55940298c59920c1313fcac', 'request_id': 'req-2410943d-63e9-4153-8f04-dd655f8e187d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.201277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2f5bd96f2a479dae04b998ac1e5350', 'request_id': 'req-969b5be1-9dda-454c-8735-e0a036e3dfa2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.205622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] The token cache is being invalidate because project 021f3ee7c55940298c59920c1313fcac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:21.206053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.206725 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.211946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 895/1789] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:20 2022] DELETE /identity/v3/projects/021f3ee7c55940298c59920c1313fcac => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:21.213077 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:21.215043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:21.233277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2f5bd96f2a479dae04b998ac1e5350', 'request_id': 'req-969b5be1-9dda-454c-8735-e0a036e3dfa2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.280565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] The token cache is being invalidate because project de2f5bd96f2a479dae04b998ac1e5350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:21.280935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.282618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.288936 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 895/1790] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:21 2022] DELETE /identity/v3/projects/de2f5bd96f2a479dae04b998ac1e5350 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:21.292941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:21.307120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:21.334768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410943d-63e9-4153-8f04-dd655f8e187d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:21.467043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:21.467855 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:21.468288 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:21.468575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] PATH_INFO: `/v3/users/3220e3e5e2a64dee97c53fa41556d98c` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:21.470009 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3220e3e5e2a64dee97c53fa41556d98c)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:21.471992 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:21.482953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b5be1-9dda-454c-8735-e0a036e3dfa2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:21.503331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:21.505400 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:21.505890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:21.506511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] PATH_INFO: `/v3/users/9c995e37272c4310a981a6fc963392e0` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:21.511643 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c995e37272c4310a981a6fc963392e0)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:21.514072 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:21.565705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3220e3e5e2a64dee97c53fa41556d98c'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.576314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3220e3e5e2a64dee97c53fa41556d98c'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.603706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3220e3e5e2a64dee97c53fa41556d98c'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.605046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3220e3e5e2a64dee97c53fa41556d98c'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.611665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c995e37272c4310a981a6fc963392e0'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.624876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c995e37272c4310a981a6fc963392e0'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.630811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3220e3e5e2a64dee97c53fa41556d98c'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.660393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c995e37272c4310a981a6fc963392e0'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.661376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c995e37272c4310a981a6fc963392e0'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.662115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c995e37272c4310a981a6fc963392e0'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:21.663583 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 896/1791] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:21 2022] DELETE /identity/v3/users/3220e3e5e2a64dee97c53fa41556d98c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:21.664501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:21.689899 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:21.691099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 896/1792] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:21 2022] DELETE /identity/v3/users/9c995e37272c4310a981a6fc963392e0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:21.843293 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac26bad-c9b4-446e-8339-f0ce870839d1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:21.954518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:21.955417 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:21.955681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:21.955961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] PATH_INFO: `/v3/users/bb244d01a3c34f409b52f9625be7de57` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:21.957321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb244d01a3c34f409b52f9625be7de57)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:21.980731 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:22.117296 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb244d01a3c34f409b52f9625be7de57'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:22.146669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb244d01a3c34f409b52f9625be7de57'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:22.190773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb244d01a3c34f409b52f9625be7de57'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:22.191868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb244d01a3c34f409b52f9625be7de57'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:22.202401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb244d01a3c34f409b52f9625be7de57'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:22.210702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 897/1793] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:21 2022] DELETE /identity/v3/users/bb244d01a3c34f409b52f9625be7de57 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:22.623379 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:22.625003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:22.656082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da76af-eba6-4116-bc5e-e50d10065d42 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:22.750656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:22.752146 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:22.863091 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:22.864524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:22.865136 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:22.865554 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] PATH_INFO: `/v3/projects/0be5c0a1e97f4be48c184b2635b11696` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:22.867965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be5c0a1e97f4be48c184b2635b11696)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:22.870576 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:22.895771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6553b1e-0458-4a3e-ab8b-ea548e5d8577 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:22.901918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99671916-4057-485a-bd71-e39205e79ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:22.903346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99671916-4057-485a-bd71-e39205e79ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:22.903631 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99671916-4057-485a-bd71-e39205e79ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:22.903907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99671916-4057-485a-bd71-e39205e79ab6 admin admin] PATH_INFO: `/v3/projects/24d0b2c9ef4a4c30917bef6038cfbead` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:22.905282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99671916-4057-485a-bd71-e39205e79ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d0b2c9ef4a4c30917bef6038cfbead)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:22.907379 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99671916-4057-485a-bd71-e39205e79ab6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:22.977598 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be5c0a1e97f4be48c184b2635b11696', 'request_id': 'req-efc6394b-d813-41ad-acb2-10a563a08bb9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.000508 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be5c0a1e97f4be48c184b2635b11696', 'request_id': 'req-efc6394b-d813-41ad-acb2-10a563a08bb9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.013332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99671916-4057-485a-bd71-e39205e79ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d0b2c9ef4a4c30917bef6038cfbead', 'request_id': 'req-99671916-4057-485a-bd71-e39205e79ab6'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.013847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be5c0a1e97f4be48c184b2635b11696', 'request_id': 'req-efc6394b-d813-41ad-acb2-10a563a08bb9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.028956 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] The token cache is being invalidate because project 0be5c0a1e97f4be48c184b2635b11696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:23.029330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.035022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99671916-4057-485a-bd71-e39205e79ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d0b2c9ef4a4c30917bef6038cfbead', 'request_id': 'req-99671916-4057-485a-bd71-e39205e79ab6'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.046550 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.048521 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 897/1794] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:22 2022] DELETE /identity/v3/projects/0be5c0a1e97f4be48c184b2635b11696 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:23.049450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:23.051347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:23.056544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99671916-4057-485a-bd71-e39205e79ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d0b2c9ef4a4c30917bef6038cfbead', 'request_id': 'req-99671916-4057-485a-bd71-e39205e79ab6'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.068765 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99671916-4057-485a-bd71-e39205e79ab6 admin admin] The token cache is being invalidate because project 24d0b2c9ef4a4c30917bef6038cfbead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:23.069368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99671916-4057-485a-bd71-e39205e79ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.070738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99671916-4057-485a-bd71-e39205e79ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.072950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 898/1795] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:22 2022] DELETE /identity/v3/projects/24d0b2c9ef4a4c30917bef6038cfbead => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:23.074673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c4c91-a899-4305-9d66-51d065e448eb None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:23.075121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c4c91-a899-4305-9d66-51d065e448eb None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:23.075829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c4c91-a899-4305-9d66-51d065e448eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:23.111639 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-1c7c4c91-a899-4305-9d66-51d065e448eb None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:23.113066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1c7c4c91-a899-4305-9d66-51d065e448eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:23.166912 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6394b-d813-41ad-acb2-10a563a08bb9 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:23.182784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 899/1796] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:23.184305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c4c91-a899-4305-9d66-51d065e448eb None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:23.185632 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1c7c4c91-a899-4305-9d66-51d065e448eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:23.199423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c4c91-a899-4305-9d66-51d065e448eb None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:23.204990 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9178e08-5415-4393-80b9-13cd7e396d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:23.205355 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178e08-5415-4393-80b9-13cd7e396d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:23.205647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178e08-5415-4393-80b9-13cd7e396d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:23.205924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178e08-5415-4393-80b9-13cd7e396d9b admin admin] PATH_INFO: `/v3/users/b5f341d7178b482a8285be27c1282587` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:23.208890 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9178e08-5415-4393-80b9-13cd7e396d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f341d7178b482a8285be27c1282587)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:23.211787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9178e08-5415-4393-80b9-13cd7e396d9b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:23.271155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02427a-e56b-4e84-bf93-ea4026558aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:23.272037 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02427a-e56b-4e84-bf93-ea4026558aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:23.272310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02427a-e56b-4e84-bf93-ea4026558aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:23.272596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02427a-e56b-4e84-bf93-ea4026558aab admin admin] PATH_INFO: `/v3/projects/84a87e5beda448d582adbeb71f6f1f83` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:23.274702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02427a-e56b-4e84-bf93-ea4026558aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a87e5beda448d582adbeb71f6f1f83)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:23.276636 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02427a-e56b-4e84-bf93-ea4026558aab admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:23.286930 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a9178e08-5415-4393-80b9-13cd7e396d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f341d7178b482a8285be27c1282587'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.296257 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a9178e08-5415-4393-80b9-13cd7e396d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f341d7178b482a8285be27c1282587'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.313508 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a9178e08-5415-4393-80b9-13cd7e396d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f341d7178b482a8285be27c1282587'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.314487 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a9178e08-5415-4393-80b9-13cd7e396d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f341d7178b482a8285be27c1282587'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.322947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a9178e08-5415-4393-80b9-13cd7e396d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f341d7178b482a8285be27c1282587'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.331038 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 900/1797] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:23 2022] DELETE /identity/v3/users/b5f341d7178b482a8285be27c1282587 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:23.332889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6aa1b-7582-4130-8ead-246777d6a1cf None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:23.333363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6aa1b-7582-4130-8ead-246777d6a1cf None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:23.333926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6aa1b-7582-4130-8ead-246777d6a1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:23.341403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ae02427a-e56b-4e84-bf93-ea4026558aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a87e5beda448d582adbeb71f6f1f83', 'request_id': 'req-ae02427a-e56b-4e84-bf93-ea4026558aab'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.349891 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ae02427a-e56b-4e84-bf93-ea4026558aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a87e5beda448d582adbeb71f6f1f83', 'request_id': 'req-ae02427a-e56b-4e84-bf93-ea4026558aab'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.361976 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ae02427a-e56b-4e84-bf93-ea4026558aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a87e5beda448d582adbeb71f6f1f83', 'request_id': 'req-ae02427a-e56b-4e84-bf93-ea4026558aab'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.363413 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-5ee6aa1b-7582-4130-8ead-246777d6a1cf None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:23.364427 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5ee6aa1b-7582-4130-8ead-246777d6a1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:23.375484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ae02427a-e56b-4e84-bf93-ea4026558aab admin admin] The token cache is being invalidate because project 84a87e5beda448d582adbeb71f6f1f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:23.375775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ae02427a-e56b-4e84-bf93-ea4026558aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.376677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ae02427a-e56b-4e84-bf93-ea4026558aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.382238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 898/1798] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:23 2022] DELETE /identity/v3/projects/84a87e5beda448d582adbeb71f6f1f83 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:23.383851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc0e40-fc68-4352-a591-e8198ff741a2 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:23.384139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc0e40-fc68-4352-a591-e8198ff741a2 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:23.384413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc0e40-fc68-4352-a591-e8198ff741a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:23.411942 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-08bc0e40-fc68-4352-a591-e8198ff741a2 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:23.414638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-08bc0e40-fc68-4352-a591-e8198ff741a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:23.517720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 901/1799] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:23.518748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6aa1b-7582-4130-8ead-246777d6a1cf None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:23.533527 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 899/1800] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:23.535319 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb1b2-99af-4682-b184-135c762169b8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:23.535701 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb1b2-99af-4682-b184-135c762169b8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:23.535852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6aa1b-7582-4130-8ead-246777d6a1cf None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:23.536163 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb1b2-99af-4682-b184-135c762169b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:23.546185 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624e7d-2354-4c46-be27-48e238112ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:23.546895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624e7d-2354-4c46-be27-48e238112ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:23.548076 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624e7d-2354-4c46-be27-48e238112ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:23.548404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624e7d-2354-4c46-be27-48e238112ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:23.552977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624e7d-2354-4c46-be27-48e238112ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:23.553352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624e7d-2354-4c46-be27-48e238112ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:23.555094 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624e7d-2354-4c46-be27-48e238112ca9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:23.574023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2dabb1b2-99af-4682-b184-135c762169b8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:23.575949 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2dabb1b2-99af-4682-b184-135c762169b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:23.593645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 902/1801] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:23.594315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624e7d-2354-4c46-be27-48e238112ca9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:23.601716 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 900/1802] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:23.602964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb1b2-99af-4682-b184-135c762169b8 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:23.609481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624e7d-2354-4c46-be27-48e238112ca9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:23.615611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e336cf-6483-46c2-9a85-da8ef2211789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:23.616387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e336cf-6483-46c2-9a85-da8ef2211789 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:23.616805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e336cf-6483-46c2-9a85-da8ef2211789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:23.617290 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e336cf-6483-46c2-9a85-da8ef2211789 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:23.618159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e336cf-6483-46c2-9a85-da8ef2211789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:23.619751 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb1b2-99af-4682-b184-135c762169b8 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:23.620878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e336cf-6483-46c2-9a85-da8ef2211789 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:23.638240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a143169-926d-4c6c-99ab-e6fd7f54552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:23.638807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a143169-926d-4c6c-99ab-e6fd7f54552b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:23.638807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a143169-926d-4c6c-99ab-e6fd7f54552b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:23.639456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a143169-926d-4c6c-99ab-e6fd7f54552b admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:23.644277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a143169-926d-4c6c-99ab-e6fd7f54552b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:23.645856 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a143169-926d-4c6c-99ab-e6fd7f54552b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:23.649470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a143169-926d-4c6c-99ab-e6fd7f54552b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:23.680012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 901/1803] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:23.684392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a143169-926d-4c6c-99ab-e6fd7f54552b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:23.687694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3a143169-926d-4c6c-99ab-e6fd7f54552b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:23.702967 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a143169-926d-4c6c-99ab-e6fd7f54552b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:23.707064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 903/1804] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:23 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:23.713268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e336cf-6483-46c2-9a85-da8ef2211789 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:23.713550 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:23.714620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:23.714923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:23.715164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] PATH_INFO: `/v3/projects/3c65c4a8b9204043b33a85d8fa6929b7` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:23.718142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c65c4a8b9204043b33a85d8fa6929b7)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:23.719988 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:23.820448 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c65c4a8b9204043b33a85d8fa6929b7', 'request_id': 'req-2d5af93a-4e30-4333-b746-0c83c176119c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.838111 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c65c4a8b9204043b33a85d8fa6929b7', 'request_id': 'req-2d5af93a-4e30-4333-b746-0c83c176119c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.872567 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c65c4a8b9204043b33a85d8fa6929b7', 'request_id': 'req-2d5af93a-4e30-4333-b746-0c83c176119c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.874003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e336cf-6483-46c2-9a85-da8ef2211789 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:23.894225 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] The token cache is being invalidate because project 3c65c4a8b9204043b33a85d8fa6929b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:23.894657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.906489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:23.906489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 902/1805] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:23 2022] DELETE /identity/v3/projects/3c65c4a8b9204043b33a85d8fa6929b7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:23.906897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:23.907860 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:23.964843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3c679-fd35-4126-9e7f-cbde04f381cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:23.965509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3c679-fd35-4126-9e7f-cbde04f381cb admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:23.965789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3c679-fd35-4126-9e7f-cbde04f381cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:23.966062 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3c679-fd35-4126-9e7f-cbde04f381cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:23.966910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3c679-fd35-4126-9e7f-cbde04f381cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:23.968756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3c679-fd35-4126-9e7f-cbde04f381cb admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:23.988776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5af93a-4e30-4333-b746-0c83c176119c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:23.994050 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53693936-84ff-4628-8928-53b05e217e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:23.994772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53693936-84ff-4628-8928-53b05e217e65 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:23.995232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53693936-84ff-4628-8928-53b05e217e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:23.995514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53693936-84ff-4628-8928-53b05e217e65 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:23.996273 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53693936-84ff-4628-8928-53b05e217e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:23.998321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53693936-84ff-4628-8928-53b05e217e65 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.007268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 904/1806] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:23 2022] POST /identity/v3/projects => generated 363 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:24.009158 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954a989-c4ab-4230-ad10-1f1d0fbf3480 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.009598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954a989-c4ab-4230-ad10-1f1d0fbf3480 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.009875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954a989-c4ab-4230-ad10-1f1d0fbf3480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.033791 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-1954a989-c4ab-4230-ad10-1f1d0fbf3480 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:24.035289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1954a989-c4ab-4230-ad10-1f1d0fbf3480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:24.038776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 903/1807] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:23 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:24.039573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53693936-84ff-4628-8928-53b05e217e65 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.044492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-53693936-84ff-4628-8928-53b05e217e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:24.074006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53693936-84ff-4628-8928-53b05e217e65 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.117742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 905/1808] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:24.125096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954a989-c4ab-4230-ad10-1f1d0fbf3480 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.139408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954a989-c4ab-4230-ad10-1f1d0fbf3480 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.144232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605090a-2b58-4cf8-962c-2934877ac2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.144910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605090a-2b58-4cf8-962c-2934877ac2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.145187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605090a-2b58-4cf8-962c-2934877ac2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.145493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605090a-2b58-4cf8-962c-2934877ac2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.146261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605090a-2b58-4cf8-962c-2934877ac2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.147893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605090a-2b58-4cf8-962c-2934877ac2ab admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.165710 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6e56e-7a11-401b-9184-99e2a6ec9a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.166533 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6e56e-7a11-401b-9184-99e2a6ec9a74 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.166908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6e56e-7a11-401b-9184-99e2a6ec9a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.167268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6e56e-7a11-401b-9184-99e2a6ec9a74 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.168036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6e56e-7a11-401b-9184-99e2a6ec9a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.170033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6e56e-7a11-401b-9184-99e2a6ec9a74 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.170452 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 906/1809] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:24.174778 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698608-1d88-4f70-8338-5b72b8806e7c None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.175971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698608-1d88-4f70-8338-5b72b8806e7c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.176465 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698608-1d88-4f70-8338-5b72b8806e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.199429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 904/1810] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:24 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:24.200303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-0f698608-1d88-4f70-8338-5b72b8806e7c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:24.201057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6e56e-7a11-401b-9184-99e2a6ec9a74 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.201511 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0f698608-1d88-4f70-8338-5b72b8806e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:24.215151 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 907/1811] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:24.215336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6e56e-7a11-401b-9184-99e2a6ec9a74 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.215447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f698608-1d88-4f70-8338-5b72b8806e7c None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.221052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220c87d-387b-4771-b017-5fc381ba3fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.221780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220c87d-387b-4771-b017-5fc381ba3fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.222400 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220c87d-387b-4771-b017-5fc381ba3fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.222755 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220c87d-387b-4771-b017-5fc381ba3fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.223618 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f698608-1d88-4f70-8338-5b72b8806e7c None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.223830 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220c87d-387b-4771-b017-5fc381ba3fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.225740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220c87d-387b-4771-b017-5fc381ba3fe9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.229373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba2530-6193-43a4-87c6-4ecf5ee6a8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.230121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba2530-6193-43a4-87c6-4ecf5ee6a8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.230585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba2530-6193-43a4-87c6-4ecf5ee6a8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.230820 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba2530-6193-43a4-87c6-4ecf5ee6a8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.231612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba2530-6193-43a4-87c6-4ecf5ee6a8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.234396 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba2530-6193-43a4-87c6-4ecf5ee6a8d9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.242335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 905/1812] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:24.243066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220c87d-387b-4771-b017-5fc381ba3fe9 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.254064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 908/1813] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:24.258407 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba2530-6193-43a4-87c6-4ecf5ee6a8d9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.265222 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220c87d-387b-4771-b017-5fc381ba3fe9 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.268549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba2530-6193-43a4-87c6-4ecf5ee6a8d9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.270908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f7c65-cd0f-407b-9334-4ccff63c0699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.271575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f7c65-cd0f-407b-9334-4ccff63c0699 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.271859 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f7c65-cd0f-407b-9334-4ccff63c0699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.272134 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f7c65-cd0f-407b-9334-4ccff63c0699 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.272862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f7c65-cd0f-407b-9334-4ccff63c0699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:24.273196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f7c65-cd0f-407b-9334-4ccff63c0699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.274761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fad9f0-1950-4ddf-be10-4c6cfd4951b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.274871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f7c65-cd0f-407b-9334-4ccff63c0699 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.275802 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fad9f0-1950-4ddf-be10-4c6cfd4951b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.276092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fad9f0-1950-4ddf-be10-4c6cfd4951b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.276383 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fad9f0-1950-4ddf-be10-4c6cfd4951b6 admin admin] PATH_INFO: `/v3/projects/af325ba678c34d8ca8829f4f05194df7/users/dd6b2823c0244b5897697de650b6da5b/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.293351 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 906/1814] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:24.297614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f7c65-cd0f-407b-9334-4ccff63c0699 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.300968 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fad9f0-1950-4ddf-be10-4c6cfd4951b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af325ba678c34d8ca8829f4f05194df7, user_id=dd6b2823c0244b5897697de650b6da5b, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.304785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fad9f0-1950-4ddf-be10-4c6cfd4951b6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.308171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f7c65-cd0f-407b-9334-4ccff63c0699 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.313833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccc68b-7a0a-438a-929d-a707b1bc0c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.314568 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc68b-7a0a-438a-929d-a707b1bc0c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.314855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc68b-7a0a-438a-929d-a707b1bc0c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.315132 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc68b-7a0a-438a-929d-a707b1bc0c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.316047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccc68b-7a0a-438a-929d-a707b1bc0c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.317661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccc68b-7a0a-438a-929d-a707b1bc0c49 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.322150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 909/1815] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:24 2022] PUT /identity/v3/projects/af325ba678c34d8ca8829f4f05194df7/users/dd6b2823c0244b5897697de650b6da5b/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:24.322924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fad9f0-1950-4ddf-be10-4c6cfd4951b6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.329392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 907/1816] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:24.333901 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863835f-e755-407b-879a-6db82929b94f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.334299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863835f-e755-407b-879a-6db82929b94f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.334682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863835f-e755-407b-879a-6db82929b94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.364293 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-1863835f-e755-407b-879a-6db82929b94f None None] MFA Rules not processed for user `dd6b2823c0244b5897697de650b6da5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:24.365659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-1863835f-e755-407b-879a-6db82929b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:24.393764 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fad9f0-1950-4ddf-be10-4c6cfd4951b6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.399150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006caa3-0fb4-4048-bc21-1995ec3a2ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.399973 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006caa3-0fb4-4048-bc21-1995ec3a2ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.400404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006caa3-0fb4-4048-bc21-1995ec3a2ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.400683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006caa3-0fb4-4048-bc21-1995ec3a2ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.401382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006caa3-0fb4-4048-bc21-1995ec3a2ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.403345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006caa3-0fb4-4048-bc21-1995ec3a2ad6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.437610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 910/1817] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:24 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:24.437610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006caa3-0fb4-4048-bc21-1995ec3a2ad6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.441723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 908/1818] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:24.442621 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863835f-e755-407b-879a-6db82929b94f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.452940 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863835f-e755-407b-879a-6db82929b94f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.494124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006caa3-0fb4-4048-bc21-1995ec3a2ad6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.498747 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfda17-c48a-4489-b35b-22b8ed3a6cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.499626 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfda17-c48a-4489-b35b-22b8ed3a6cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.499906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfda17-c48a-4489-b35b-22b8ed3a6cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.500168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfda17-c48a-4489-b35b-22b8ed3a6cf9 admin admin] PATH_INFO: `/v3/projects/7558c012e47d489793089e87c65ff987/users/935c3cce98554eae9307b22a1ca5e79e/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.507555 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c599d1b-0be2-4e3a-98b7-ba51e1a60b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.508236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599d1b-0be2-4e3a-98b7-ba51e1a60b33 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.508507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599d1b-0be2-4e3a-98b7-ba51e1a60b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.508787 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599d1b-0be2-4e3a-98b7-ba51e1a60b33 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.509481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c599d1b-0be2-4e3a-98b7-ba51e1a60b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.511444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c599d1b-0be2-4e3a-98b7-ba51e1a60b33 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.513856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfda17-c48a-4489-b35b-22b8ed3a6cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7558c012e47d489793089e87c65ff987, user_id=935c3cce98554eae9307b22a1ca5e79e, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.516509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfda17-c48a-4489-b35b-22b8ed3a6cf9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.530449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 911/1819] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:24 2022] PUT /identity/v3/projects/7558c012e47d489793089e87c65ff987/users/935c3cce98554eae9307b22a1ca5e79e/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:24.531253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfda17-c48a-4489-b35b-22b8ed3a6cf9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.531722 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 909/1820] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:24 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:24.535558 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c599d1b-0be2-4e3a-98b7-ba51e1a60b33 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.542168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9edfda17-c48a-4489-b35b-22b8ed3a6cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:24.546107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c599d1b-0be2-4e3a-98b7-ba51e1a60b33 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.597346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfda17-c48a-4489-b35b-22b8ed3a6cf9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.600424 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368573d-d8da-4b1e-9125-3536d11b5f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.600816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e46a25-4fed-4b0f-828d-afd218a9a3c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.601777 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368573d-d8da-4b1e-9125-3536d11b5f46 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.601989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e46a25-4fed-4b0f-828d-afd218a9a3c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.602197 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368573d-d8da-4b1e-9125-3536d11b5f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.602324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e46a25-4fed-4b0f-828d-afd218a9a3c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.602556 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e46a25-4fed-4b0f-828d-afd218a9a3c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.602660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368573d-d8da-4b1e-9125-3536d11b5f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.603465 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368573d-d8da-4b1e-9125-3536d11b5f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.605152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368573d-d8da-4b1e-9125-3536d11b5f46 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.614946 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 910/1821] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:38:24.616246 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612d2d0-e483-4287-9ade-c66fda089df2 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.616608 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612d2d0-e483-4287-9ade-c66fda089df2 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.617521 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612d2d0-e483-4287-9ade-c66fda089df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.643602 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-d612d2d0-e483-4287-9ade-c66fda089df2 None None] MFA Rules not processed for user `935c3cce98554eae9307b22a1ca5e79e`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:24.645426 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d612d2d0-e483-4287-9ade-c66fda089df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:24.658756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e46a25-4fed-4b0f-828d-afd218a9a3c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.660226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e46a25-4fed-4b0f-828d-afd218a9a3c3 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.672123 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 912/1822] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:24.673121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e46a25-4fed-4b0f-828d-afd218a9a3c3 service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.695780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e46a25-4fed-4b0f-828d-afd218a9a3c3 service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.713762 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b5c53-8df3-4301-8293-f252e2a51f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.713762 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b5c53-8df3-4301-8293-f252e2a51f21 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.713762 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b5c53-8df3-4301-8293-f252e2a51f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.713762 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b5c53-8df3-4301-8293-f252e2a51f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.714416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b5c53-8df3-4301-8293-f252e2a51f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.714416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b5c53-8df3-4301-8293-f252e2a51f21 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.721161 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 911/1823] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:24.722160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612d2d0-e483-4287-9ade-c66fda089df2 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.734704 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612d2d0-e483-4287-9ade-c66fda089df2 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.740535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1ec02-f078-4876-9cdd-91c22f0cd3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.741045 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 913/1824] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:24.741334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1ec02-f078-4876-9cdd-91c22f0cd3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.744371 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1ec02-f078-4876-9cdd-91c22f0cd3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.744844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1ec02-f078-4876-9cdd-91c22f0cd3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.745674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1ec02-f078-4876-9cdd-91c22f0cd3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.746361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b5c53-8df3-4301-8293-f252e2a51f21 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.748885 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1ec02-f078-4876-9cdd-91c22f0cd3c4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.763964 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b5c53-8df3-4301-8293-f252e2a51f21 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:24.775638 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1bb79-2433-4b4f-8349-6d1b1cca65b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:24.775982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1bb79-2433-4b4f-8349-6d1b1cca65b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.776513 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1bb79-2433-4b4f-8349-6d1b1cca65b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.776513 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1bb79-2433-4b4f-8349-6d1b1cca65b3 admin admin] PATH_INFO: `/v3/projects/07929210698d457c9edeed6fff9cfbc2/users/d3eb63f8ecb64366a18d5e909aef0837/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.795997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1bb79-2433-4b4f-8349-6d1b1cca65b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07929210698d457c9edeed6fff9cfbc2, user_id=d3eb63f8ecb64366a18d5e909aef0837, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:24.799024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 912/1825] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:24 2022] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:24.799933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1ec02-f078-4876-9cdd-91c22f0cd3c4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:24.800212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1bb79-2433-4b4f-8349-6d1b1cca65b3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:24.830825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 914/1826] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:24 2022] PUT /identity/v3/projects/07929210698d457c9edeed6fff9cfbc2/users/d3eb63f8ecb64366a18d5e909aef0837/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:24.842976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871c28b-f509-485c-a790-23e3f61dc8e1 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:24.843295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871c28b-f509-485c-a790-23e3f61dc8e1 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:24.843542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871c28b-f509-485c-a790-23e3f61dc8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:24.884844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b871c28b-f509-485c-a790-23e3f61dc8e1 None None] MFA Rules not processed for user `d3eb63f8ecb64366a18d5e909aef0837`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:24.886319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b871c28b-f509-485c-a790-23e3f61dc8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:24.951837 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1ec02-f078-4876-9cdd-91c22f0cd3c4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:25.023931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 915/1827] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:25.028953 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871c28b-f509-485c-a790-23e3f61dc8e1 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:25.105102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44effc-602b-453c-a9e7-3900b39780a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:25.105102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44effc-602b-453c-a9e7-3900b39780a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.105102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44effc-602b-453c-a9e7-3900b39780a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.105716 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44effc-602b-453c-a9e7-3900b39780a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.107162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44effc-602b-453c-a9e7-3900b39780a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:25.110953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44effc-602b-453c-a9e7-3900b39780a9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:25.150341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 913/1828] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:24 2022] POST /identity/v3/users => generated 288 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:25.151953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44effc-602b-453c-a9e7-3900b39780a9 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:25.166702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44effc-602b-453c-a9e7-3900b39780a9 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:25.169344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871c28b-f509-485c-a790-23e3f61dc8e1 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:25.177121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a227bd-031a-4dcd-ac87-d4d9b9270a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:25.177312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a0a60-d0cc-404c-812a-49885e656ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:25.177805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a227bd-031a-4dcd-ac87-d4d9b9270a60 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.178093 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a227bd-031a-4dcd-ac87-d4d9b9270a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.178412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a227bd-031a-4dcd-ac87-d4d9b9270a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.179033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a0a60-d0cc-404c-812a-49885e656ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.179178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a227bd-031a-4dcd-ac87-d4d9b9270a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:25.179696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a0a60-d0cc-404c-812a-49885e656ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.180873 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a0a60-d0cc-404c-812a-49885e656ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.181082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a227bd-031a-4dcd-ac87-d4d9b9270a60 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:25.182453 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a0a60-d0cc-404c-812a-49885e656ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:25.184254 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a0a60-d0cc-404c-812a-49885e656ac4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:25.197432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 914/1829] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:25.201457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a0a60-d0cc-404c-812a-49885e656ac4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:25.214959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a0a60-d0cc-404c-812a-49885e656ac4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:25.234673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 916/1830] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:25 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:25.235534 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda103d-42b9-424d-83ac-79f81037c492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:25.236298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda103d-42b9-424d-83ac-79f81037c492 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.236586 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda103d-42b9-424d-83ac-79f81037c492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.236752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a227bd-031a-4dcd-ac87-d4d9b9270a60 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:25.236848 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda103d-42b9-424d-83ac-79f81037c492 admin admin] PATH_INFO: `/v3/projects/3a49f8be3d2147be89af02d857a7ff0a/users/da3f766fe7c349ae88d82e85ba318eec/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.270774 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda103d-42b9-424d-83ac-79f81037c492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a49f8be3d2147be89af02d857a7ff0a, user_id=da3f766fe7c349ae88d82e85ba318eec, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:25.280809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda103d-42b9-424d-83ac-79f81037c492 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:25.319178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 915/1831] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:25 2022] PUT /identity/v3/projects/3a49f8be3d2147be89af02d857a7ff0a/users/da3f766fe7c349ae88d82e85ba318eec/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:25.320810 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda103d-42b9-424d-83ac-79f81037c492 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:25.383344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a227bd-031a-4dcd-ac87-d4d9b9270a60 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:25.411968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda103d-42b9-424d-83ac-79f81037c492 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:25.427206 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37f42f-1666-42d2-8adb-3aacf7f3985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:25.429159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37f42f-1666-42d2-8adb-3aacf7f3985c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.430525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37f42f-1666-42d2-8adb-3aacf7f3985c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.430960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37f42f-1666-42d2-8adb-3aacf7f3985c admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.432976 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37f42f-1666-42d2-8adb-3aacf7f3985c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:25.438909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37f42f-1666-42d2-8adb-3aacf7f3985c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:25.468124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 916/1832] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:25.473307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37f42f-1666-42d2-8adb-3aacf7f3985c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:25.489641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37f42f-1666-42d2-8adb-3aacf7f3985c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:25.500427 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c44850-17c2-40f8-92dd-68e4fd97930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:25.506238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c44850-17c2-40f8-92dd-68e4fd97930d admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.506238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c44850-17c2-40f8-92dd-68e4fd97930d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.506238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c44850-17c2-40f8-92dd-68e4fd97930d admin admin] PATH_INFO: `/v3/projects/3a49f8be3d2147be89af02d857a7ff0a/users/da3f766fe7c349ae88d82e85ba318eec/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.508792 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c44850-17c2-40f8-92dd-68e4fd97930d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a49f8be3d2147be89af02d857a7ff0a, user_id=da3f766fe7c349ae88d82e85ba318eec, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:25.516304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c44850-17c2-40f8-92dd-68e4fd97930d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:25.529790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 917/1833] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:25 2022] PUT /identity/v3/projects/3a49f8be3d2147be89af02d857a7ff0a/users/da3f766fe7c349ae88d82e85ba318eec/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:25.540069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b228b76-bb06-4a09-abfa-245dbd589faf None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.540567 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b228b76-bb06-4a09-abfa-245dbd589faf None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.541130 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b228b76-bb06-4a09-abfa-245dbd589faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.543935 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5983ead-69da-48cd-9295-4974aab687f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:25.544819 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5983ead-69da-48cd-9295-4974aab687f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.545263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5983ead-69da-48cd-9295-4974aab687f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.545696 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5983ead-69da-48cd-9295-4974aab687f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.546614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5983ead-69da-48cd-9295-4974aab687f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:25.548781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5983ead-69da-48cd-9295-4974aab687f6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:25.604750 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 917/1834] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:25 2022] POST /identity/v3/users => generated 297 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:25.605923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-6b228b76-bb06-4a09-abfa-245dbd589faf None None] MFA Rules not processed for user `da3f766fe7c349ae88d82e85ba318eec`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:25.607361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6b228b76-bb06-4a09-abfa-245dbd589faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:25.614509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5983ead-69da-48cd-9295-4974aab687f6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:25.627130 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5983ead-69da-48cd-9295-4974aab687f6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:25.716437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 918/1835] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:25 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:25.717001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a82407-28e9-4a0b-9163-2439d2ef599f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:25.717163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a82407-28e9-4a0b-9163-2439d2ef599f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.717349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a82407-28e9-4a0b-9163-2439d2ef599f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.717628 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a82407-28e9-4a0b-9163-2439d2ef599f admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.718423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a82407-28e9-4a0b-9163-2439d2ef599f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:25.720076 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a82407-28e9-4a0b-9163-2439d2ef599f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:25.724883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b228b76-bb06-4a09-abfa-245dbd589faf None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:25.731540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 918/1836] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:25.735619 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a82407-28e9-4a0b-9163-2439d2ef599f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:25.746678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a82407-28e9-4a0b-9163-2439d2ef599f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:25.751797 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a2e7c-f119-45cf-b89f-0c267a8ecec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:25.752880 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a2e7c-f119-45cf-b89f-0c267a8ecec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.753433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a2e7c-f119-45cf-b89f-0c267a8ecec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.754246 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a2e7c-f119-45cf-b89f-0c267a8ecec2 admin admin] PATH_INFO: `/v3/projects/1475ec90bf394e5f8aa66c77676684d1/users/a5af9fce55e040cea622f5108e4da9df/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.774609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a2e7c-f119-45cf-b89f-0c267a8ecec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1475ec90bf394e5f8aa66c77676684d1, user_id=a5af9fce55e040cea622f5108e4da9df, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:25.777458 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a2e7c-f119-45cf-b89f-0c267a8ecec2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:25.792693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 919/1837] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:25 2022] PUT /identity/v3/projects/1475ec90bf394e5f8aa66c77676684d1/users/a5af9fce55e040cea622f5108e4da9df/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:25.796364 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a2e7c-f119-45cf-b89f-0c267a8ecec2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:25.799625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b228b76-bb06-4a09-abfa-245dbd589faf None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:25.859633 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfb212-a001-4107-81b2-aa1dc075d4dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:25.860475 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfb212-a001-4107-81b2-aa1dc075d4dd service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.860867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfb212-a001-4107-81b2-aa1dc075d4dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.861289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfb212-a001-4107-81b2-aa1dc075d4dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.869631 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a2e7c-f119-45cf-b89f-0c267a8ecec2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:25.874433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52512efd-da58-48b6-a642-09356ff7164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:25.875097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52512efd-da58-48b6-a642-09356ff7164d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.875373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52512efd-da58-48b6-a642-09356ff7164d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.875654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52512efd-da58-48b6-a642-09356ff7164d admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.876375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52512efd-da58-48b6-a642-09356ff7164d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:25.878651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52512efd-da58-48b6-a642-09356ff7164d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:25.892431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 920/1838] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:38:25.893431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52512efd-da58-48b6-a642-09356ff7164d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:25.904481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52512efd-da58-48b6-a642-09356ff7164d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:25.909436 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bcd74-b129-4bfc-8714-b603519d6ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:25.910668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcd74-b129-4bfc-8714-b603519d6ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.910953 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcd74-b129-4bfc-8714-b603519d6ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.911231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcd74-b129-4bfc-8714-b603519d6ed2 admin admin] PATH_INFO: `/v3/projects/1475ec90bf394e5f8aa66c77676684d1/users/a5af9fce55e040cea622f5108e4da9df/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.914219 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bcd74-b129-4bfc-8714-b603519d6ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1475ec90bf394e5f8aa66c77676684d1, user_id=a5af9fce55e040cea622f5108e4da9df, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:25.917494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bcd74-b129-4bfc-8714-b603519d6ed2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:25.927396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfb212-a001-4107-81b2-aa1dc075d4dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:25.929754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfb212-a001-4107-81b2-aa1dc075d4dd service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:25.929906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 921/1839] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:25 2022] PUT /identity/v3/projects/1475ec90bf394e5f8aa66c77676684d1/users/a5af9fce55e040cea622f5108e4da9df/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:25.939801 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5e30a-df0d-4128-87e0-bb2d3f28d91e None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:25.940090 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5e30a-df0d-4128-87e0-bb2d3f28d91e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:25.940970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5e30a-df0d-4128-87e0-bb2d3f28d91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:25.948236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 919/1840] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:25 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:38:25.970304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-83d5e30a-df0d-4128-87e0-bb2d3f28d91e None None] MFA Rules not processed for user `a5af9fce55e040cea622f5108e4da9df`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:25.971600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-83d5e30a-df0d-4128-87e0-bb2d3f28d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:26.059592 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfb212-a001-4107-81b2-aa1dc075d4dd service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:26.089113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 922/1841] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:26.098943 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfb212-a001-4107-81b2-aa1dc075d4dd service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:26.154403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5e30a-df0d-4128-87e0-bb2d3f28d91e None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:26.154403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-83d5e30a-df0d-4128-87e0-bb2d3f28d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:26.189817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343e3ec-01a3-4833-a2b1-06b13dbe17fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:26.190513 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343e3ec-01a3-4833-a2b1-06b13dbe17fa service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:26.190806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343e3ec-01a3-4833-a2b1-06b13dbe17fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:26.191069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343e3ec-01a3-4833-a2b1-06b13dbe17fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:26.229471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5e30a-df0d-4128-87e0-bb2d3f28d91e None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:26.239176 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722116b-69dc-4d0f-8e06-98e03811ac5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:26.241503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722116b-69dc-4d0f-8e06-98e03811ac5c service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:26.242192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722116b-69dc-4d0f-8e06-98e03811ac5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:26.242192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722116b-69dc-4d0f-8e06-98e03811ac5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:26.253988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722116b-69dc-4d0f-8e06-98e03811ac5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:26.254846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343e3ec-01a3-4833-a2b1-06b13dbe17fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:26.255713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722116b-69dc-4d0f-8e06-98e03811ac5c service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:26.256679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343e3ec-01a3-4833-a2b1-06b13dbe17fa service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:26.266876 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 923/1842] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:38:26.267117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 920/1843] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:26 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:26.525889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722116b-69dc-4d0f-8e06-98e03811ac5c service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:26.545003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722116b-69dc-4d0f-8e06-98e03811ac5c service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:26.550690 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b29f82-7604-4b91-90ad-0ea21f858392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:26.551477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b29f82-7604-4b91-90ad-0ea21f858392 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:26.551807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b29f82-7604-4b91-90ad-0ea21f858392 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:26.552199 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b29f82-7604-4b91-90ad-0ea21f858392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:26.625620 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b29f82-7604-4b91-90ad-0ea21f858392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:26.627515 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b29f82-7604-4b91-90ad-0ea21f858392 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:26.644559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 924/1844] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:30.211988 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343e3ec-01a3-4833-a2b1-06b13dbe17fa service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:30.326610 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343e3ec-01a3-4833-a2b1-06b13dbe17fa service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:30.339043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:30.339941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:30.340230 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:30.340839 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] PATH_INFO: `/v3/users/935c3cce98554eae9307b22a1ca5e79e` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:30.346162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=935c3cce98554eae9307b22a1ca5e79e)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:30.348935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:30.453505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935c3cce98554eae9307b22a1ca5e79e'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:30.474545 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935c3cce98554eae9307b22a1ca5e79e'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:30.504776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935c3cce98554eae9307b22a1ca5e79e'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:30.506640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935c3cce98554eae9307b22a1ca5e79e'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:30.507815 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935c3cce98554eae9307b22a1ca5e79e'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:30.535877 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 921/1845] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:30 2022] DELETE /identity/v3/users/935c3cce98554eae9307b22a1ca5e79e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:30.540704 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0b84f-9fce-471c-85f4-61b5a6acb6fd None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:30.541210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0b84f-9fce-471c-85f4-61b5a6acb6fd None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:30.541302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0b84f-9fce-471c-85f4-61b5a6acb6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:30.579199 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-3ac0b84f-9fce-471c-85f4-61b5a6acb6fd None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:30.580434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3ac0b84f-9fce-471c-85f4-61b5a6acb6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:30.697142 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 925/1846] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:30.727442 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:30.729018 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:30.859152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288efc2-5ada-4264-a174-1f4fc9de85ed admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:30.866916 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641408e-9c77-45a9-9ee1-84e14c31179d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:30.868060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641408e-9c77-45a9-9ee1-84e14c31179d service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:30.868345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641408e-9c77-45a9-9ee1-84e14c31179d service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:30.868875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641408e-9c77-45a9-9ee1-84e14c31179d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:30.880534 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641408e-9c77-45a9-9ee1-84e14c31179d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:30.882780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641408e-9c77-45a9-9ee1-84e14c31179d service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:30.894562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 922/1847] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:31.275660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0b84f-9fce-471c-85f4-61b5a6acb6fd None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:31.277254 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3ac0b84f-9fce-471c-85f4-61b5a6acb6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:31.290244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0b84f-9fce-471c-85f4-61b5a6acb6fd None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:31.294987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:31.295831 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:31.296111 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:31.296388 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] PATH_INFO: `/v3/projects/7558c012e47d489793089e87c65ff987` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:31.297593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7558c012e47d489793089e87c65ff987)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:31.299702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:31.344928 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7558c012e47d489793089e87c65ff987', 'request_id': 'req-e9f8acc8-0f33-4490-aaf3-6d418122b62b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:31.350085 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7558c012e47d489793089e87c65ff987', 'request_id': 'req-e9f8acc8-0f33-4490-aaf3-6d418122b62b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:31.357661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7558c012e47d489793089e87c65ff987', 'request_id': 'req-e9f8acc8-0f33-4490-aaf3-6d418122b62b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:31.369263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] The token cache is being invalidate because project 7558c012e47d489793089e87c65ff987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:31.369565 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:31.370174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:31.371748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 926/1848] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:31 2022] DELETE /identity/v3/projects/7558c012e47d489793089e87c65ff987 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:31.375884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641408e-9c77-45a9-9ee1-84e14c31179d service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:31.385265 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641408e-9c77-45a9-9ee1-84e14c31179d service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:31.438740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cefa6c-3166-4d9c-9cd4-1dceee16c543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:31.439596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cefa6c-3166-4d9c-9cd4-1dceee16c543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:31.439878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cefa6c-3166-4d9c-9cd4-1dceee16c543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:31.440152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cefa6c-3166-4d9c-9cd4-1dceee16c543 admin admin] PATH_INFO: `/v3/users/da3f766fe7c349ae88d82e85ba318eec` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:31.441318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cefa6c-3166-4d9c-9cd4-1dceee16c543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3f766fe7c349ae88d82e85ba318eec)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:31.443274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cefa6c-3166-4d9c-9cd4-1dceee16c543 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:31.485268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-82cefa6c-3166-4d9c-9cd4-1dceee16c543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3f766fe7c349ae88d82e85ba318eec'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:31.492232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-82cefa6c-3166-4d9c-9cd4-1dceee16c543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3f766fe7c349ae88d82e85ba318eec'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:31.503302 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-82cefa6c-3166-4d9c-9cd4-1dceee16c543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3f766fe7c349ae88d82e85ba318eec'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:31.503953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-82cefa6c-3166-4d9c-9cd4-1dceee16c543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3f766fe7c349ae88d82e85ba318eec'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:31.504572 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-82cefa6c-3166-4d9c-9cd4-1dceee16c543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3f766fe7c349ae88d82e85ba318eec'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:31.516161 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 923/1849] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:31 2022] DELETE /identity/v3/users/da3f766fe7c349ae88d82e85ba318eec => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:31.795036 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:31.796710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:31.813322 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8acc8-0f33-4490-aaf3-6d418122b62b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:31.885696 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c3f22-3709-4eab-b48a-4401d06b2e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:31.887204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3f22-3709-4eab-b48a-4401d06b2e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:31.888226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3f22-3709-4eab-b48a-4401d06b2e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:31.888524 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3f22-3709-4eab-b48a-4401d06b2e69 admin admin] PATH_INFO: `/v3/projects/3a49f8be3d2147be89af02d857a7ff0a` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:31.889918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3f22-3709-4eab-b48a-4401d06b2e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a49f8be3d2147be89af02d857a7ff0a)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:31.893368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3f22-3709-4eab-b48a-4401d06b2e69 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:31.974128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e15c3f22-3709-4eab-b48a-4401d06b2e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a49f8be3d2147be89af02d857a7ff0a', 'request_id': 'req-e15c3f22-3709-4eab-b48a-4401d06b2e69'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:31.980068 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e15c3f22-3709-4eab-b48a-4401d06b2e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a49f8be3d2147be89af02d857a7ff0a', 'request_id': 'req-e15c3f22-3709-4eab-b48a-4401d06b2e69'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:31.991714 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e15c3f22-3709-4eab-b48a-4401d06b2e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a49f8be3d2147be89af02d857a7ff0a', 'request_id': 'req-e15c3f22-3709-4eab-b48a-4401d06b2e69'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:32.005839 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e15c3f22-3709-4eab-b48a-4401d06b2e69 admin admin] The token cache is being invalidate because project 3a49f8be3d2147be89af02d857a7ff0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:32.006150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e15c3f22-3709-4eab-b48a-4401d06b2e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:32.006838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-e15c3f22-3709-4eab-b48a-4401d06b2e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:32.012490 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 927/1850] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:31 2022] DELETE /identity/v3/projects/3a49f8be3d2147be89af02d857a7ff0a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:32.016932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08256d-3666-4406-9fa4-45ac959133e8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.016932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08256d-3666-4406-9fa4-45ac959133e8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.016932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08256d-3666-4406-9fa4-45ac959133e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.048690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-ca08256d-3666-4406-9fa4-45ac959133e8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:32.049885 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ca08256d-3666-4406-9fa4-45ac959133e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:32.111243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 924/1851] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:32.119182 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433c10-fdc7-4aae-917d-9b78a433532d None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.119534 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433c10-fdc7-4aae-917d-9b78a433532d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.119841 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433c10-fdc7-4aae-917d-9b78a433532d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.140594 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-40433c10-fdc7-4aae-917d-9b78a433532d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:32.142235 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-40433c10-fdc7-4aae-917d-9b78a433532d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:32.154446 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 928/1852] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:32.155802 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08256d-3666-4406-9fa4-45ac959133e8 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:32.165768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08256d-3666-4406-9fa4-45ac959133e8 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:32.170491 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7309d9-5e74-46fe-8a00-00ad9ea6da6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:32.171541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7309d9-5e74-46fe-8a00-00ad9ea6da6e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.171828 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7309d9-5e74-46fe-8a00-00ad9ea6da6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.172099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7309d9-5e74-46fe-8a00-00ad9ea6da6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.172869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7309d9-5e74-46fe-8a00-00ad9ea6da6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:32.173127 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7309d9-5e74-46fe-8a00-00ad9ea6da6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:32.174766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7309d9-5e74-46fe-8a00-00ad9ea6da6e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:32.187002 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 925/1853] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:32.191398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40433c10-fdc7-4aae-917d-9b78a433532d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:32.200943 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40433c10-fdc7-4aae-917d-9b78a433532d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:32.205731 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c00b0d-0710-4f48-9934-3196a59b2a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:32.207069 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c00b0d-0710-4f48-9934-3196a59b2a3a admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.207356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c00b0d-0710-4f48-9934-3196a59b2a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.207633 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c00b0d-0710-4f48-9934-3196a59b2a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.208325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c00b0d-0710-4f48-9934-3196a59b2a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:32.210843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c00b0d-0710-4f48-9934-3196a59b2a3a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:32.239556 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 929/1854] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:32 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:32.240708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7309d9-5e74-46fe-8a00-00ad9ea6da6e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:32.250789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7309d9-5e74-46fe-8a00-00ad9ea6da6e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:32.306494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a30e2-3c90-4074-b9bd-e7cfe1acdf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:32.307097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a30e2-3c90-4074-b9bd-e7cfe1acdf55 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.307380 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a30e2-3c90-4074-b9bd-e7cfe1acdf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.307656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a30e2-3c90-4074-b9bd-e7cfe1acdf55 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.308340 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a30e2-3c90-4074-b9bd-e7cfe1acdf55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:32.310279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a30e2-3c90-4074-b9bd-e7cfe1acdf55 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:32.331471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 926/1855] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:32 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:32.335694 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c00b0d-0710-4f48-9934-3196a59b2a3a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:32.345552 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c00b0d-0710-4f48-9934-3196a59b2a3a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:32.350048 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058b6e0-d4c3-47dd-b779-d8ff66c532d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:32.350730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058b6e0-d4c3-47dd-b779-d8ff66c532d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.351009 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058b6e0-d4c3-47dd-b779-d8ff66c532d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.351280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058b6e0-d4c3-47dd-b779-d8ff66c532d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.351996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058b6e0-d4c3-47dd-b779-d8ff66c532d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:32.353555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058b6e0-d4c3-47dd-b779-d8ff66c532d0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:32.363806 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 930/1856] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:38:32.368239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a30e2-3c90-4074-b9bd-e7cfe1acdf55 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:32.378077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a30e2-3c90-4074-b9bd-e7cfe1acdf55 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:32.383447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29d001-0399-4ebc-8571-e25f9a4ceeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:32.384096 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29d001-0399-4ebc-8571-e25f9a4ceeee admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.384383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29d001-0399-4ebc-8571-e25f9a4ceeee admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.384668 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29d001-0399-4ebc-8571-e25f9a4ceeee admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.385396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29d001-0399-4ebc-8571-e25f9a4ceeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:32.387036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29d001-0399-4ebc-8571-e25f9a4ceeee admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:32.396571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 927/1857] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:32.400434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058b6e0-d4c3-47dd-b779-d8ff66c532d0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:32.410004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058b6e0-d4c3-47dd-b779-d8ff66c532d0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:32.414575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ba97-7995-4f03-ada7-c65e8f362744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:32.415428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ba97-7995-4f03-ada7-c65e8f362744 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.415706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ba97-7995-4f03-ada7-c65e8f362744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.415978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ba97-7995-4f03-ada7-c65e8f362744 admin admin] PATH_INFO: `/v3/projects/0733dc50faf9453790f66aea27b8b3f8/users/bc9983f861e849f5b668ccf0c4025b86/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.430332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357ba97-7995-4f03-ada7-c65e8f362744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0733dc50faf9453790f66aea27b8b3f8, user_id=bc9983f861e849f5b668ccf0c4025b86, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:32.433022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357ba97-7995-4f03-ada7-c65e8f362744 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:32.445869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 931/1858] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:32 2022] PUT /identity/v3/projects/0733dc50faf9453790f66aea27b8b3f8/users/bc9983f861e849f5b668ccf0c4025b86/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:32.456874 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e26f0-56d0-4cfe-8a44-55d74a383ab6 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.457187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e26f0-56d0-4cfe-8a44-55d74a383ab6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.457451 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e26f0-56d0-4cfe-8a44-55d74a383ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.483150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4a3e26f0-56d0-4cfe-8a44-55d74a383ab6 None None] MFA Rules not processed for user `bc9983f861e849f5b668ccf0c4025b86`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:32.484366 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4a3e26f0-56d0-4cfe-8a44-55d74a383ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:32.549822 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 928/1859] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:32.554956 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ba97-7995-4f03-ada7-c65e8f362744 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:32.613204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ba97-7995-4f03-ada7-c65e8f362744 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:32.619371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f98a4d-758f-4af2-ab48-3a630206c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:32.620025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f98a4d-758f-4af2-ab48-3a630206c58f admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.620310 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f98a4d-758f-4af2-ab48-3a630206c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.620584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f98a4d-758f-4af2-ab48-3a630206c58f admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.621281 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f98a4d-758f-4af2-ab48-3a630206c58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:32.623244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f98a4d-758f-4af2-ab48-3a630206c58f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:32.649521 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 932/1860] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:32 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:32.653494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e26f0-56d0-4cfe-8a44-55d74a383ab6 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:32.664458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e26f0-56d0-4cfe-8a44-55d74a383ab6 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:32.717575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f80bca-b9f7-459f-8578-b5e261f36d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:32.718259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f80bca-b9f7-459f-8578-b5e261f36d2d admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.718551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f80bca-b9f7-459f-8578-b5e261f36d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.718824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f80bca-b9f7-459f-8578-b5e261f36d2d admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.719509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f80bca-b9f7-459f-8578-b5e261f36d2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:32.721402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f80bca-b9f7-459f-8578-b5e261f36d2d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:32.740819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 929/1861] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:32 2022] POST /identity/v3/users => generated 298 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:32.744921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f98a4d-758f-4af2-ab48-3a630206c58f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:32.754631 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f98a4d-758f-4af2-ab48-3a630206c58f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:32.759988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bb1b2-ec9f-4a0e-bea5-9992463292e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:32.760647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb1b2-ec9f-4a0e-bea5-9992463292e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.760934 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb1b2-ec9f-4a0e-bea5-9992463292e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.761211 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb1b2-ec9f-4a0e-bea5-9992463292e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.761988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bb1b2-ec9f-4a0e-bea5-9992463292e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:32.763868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bb1b2-ec9f-4a0e-bea5-9992463292e0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:32.775097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 933/1862] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:32.779229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f80bca-b9f7-459f-8578-b5e261f36d2d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:32.788941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f80bca-b9f7-459f-8578-b5e261f36d2d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:32.793500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a8a4e-2a10-4db7-a78d-55710effcc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:32.794413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8a4e-2a10-4db7-a78d-55710effcc50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.794679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8a4e-2a10-4db7-a78d-55710effcc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.794951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8a4e-2a10-4db7-a78d-55710effcc50 admin admin] PATH_INFO: `/v3/projects/46ef23eca5874ea396384b5e5f544cbe/users/88f6085cce6a45bdb4113992850540c4/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.809027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a8a4e-2a10-4db7-a78d-55710effcc50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ef23eca5874ea396384b5e5f544cbe, user_id=88f6085cce6a45bdb4113992850540c4, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:32.811783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a8a4e-2a10-4db7-a78d-55710effcc50 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:32.825827 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 930/1863] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:32 2022] PUT /identity/v3/projects/46ef23eca5874ea396384b5e5f544cbe/users/88f6085cce6a45bdb4113992850540c4/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:32.829746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bb1b2-ec9f-4a0e-bea5-9992463292e0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:32.840393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bb1b2-ec9f-4a0e-bea5-9992463292e0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:32.897135 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92502e85-f054-47ad-ac7d-f5bbde0cc039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:32.897753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92502e85-f054-47ad-ac7d-f5bbde0cc039 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.898575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92502e85-f054-47ad-ac7d-f5bbde0cc039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.898846 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92502e85-f054-47ad-ac7d-f5bbde0cc039 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.899568 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92502e85-f054-47ad-ac7d-f5bbde0cc039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:32.901157 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92502e85-f054-47ad-ac7d-f5bbde0cc039 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:32.910554 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 934/1864] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:32.914709 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a8a4e-2a10-4db7-a78d-55710effcc50 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:32.924619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a8a4e-2a10-4db7-a78d-55710effcc50 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:32.929320 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2575ea-eac7-478f-8453-ac0b0fb04d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:32.930192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2575ea-eac7-478f-8453-ac0b0fb04d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.930508 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2575ea-eac7-478f-8453-ac0b0fb04d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.930787 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2575ea-eac7-478f-8453-ac0b0fb04d54 admin admin] PATH_INFO: `/v3/projects/46ef23eca5874ea396384b5e5f544cbe/users/88f6085cce6a45bdb4113992850540c4/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.932731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2575ea-eac7-478f-8453-ac0b0fb04d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ef23eca5874ea396384b5e5f544cbe, user_id=88f6085cce6a45bdb4113992850540c4, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:32.935409 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2575ea-eac7-478f-8453-ac0b0fb04d54 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:32.945852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 931/1865] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:32 2022] PUT /identity/v3/projects/46ef23eca5874ea396384b5e5f544cbe/users/88f6085cce6a45bdb4113992850540c4/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:32.955709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ba3dc-6f9d-4cca-b49f-2e90b1f5a44f None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:32.956062 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ba3dc-6f9d-4cca-b49f-2e90b1f5a44f None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:32.956344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ba3dc-6f9d-4cca-b49f-2e90b1f5a44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:32.983007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-fb0ba3dc-6f9d-4cca-b49f-2e90b1f5a44f None None] MFA Rules not processed for user `88f6085cce6a45bdb4113992850540c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:32.984201 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fb0ba3dc-6f9d-4cca-b49f-2e90b1f5a44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:33.050221 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 935/1866] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:33.060186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2575ea-eac7-478f-8453-ac0b0fb04d54 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:33.061834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4c2575ea-eac7-478f-8453-ac0b0fb04d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:33.134017 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2575ea-eac7-478f-8453-ac0b0fb04d54 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:33.137656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb2590-a678-4a4e-bff0-67d0ecd8da1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:33.138336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb2590-a678-4a4e-bff0-67d0ecd8da1a service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:33.138808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb2590-a678-4a4e-bff0-67d0ecd8da1a service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:33.139090 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb2590-a678-4a4e-bff0-67d0ecd8da1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:33.149748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb2590-a678-4a4e-bff0-67d0ecd8da1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:33.151149 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb2590-a678-4a4e-bff0-67d0ecd8da1a service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:33.161093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 932/1867] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:33.266361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ba3dc-6f9d-4cca-b49f-2e90b1f5a44f None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:33.267761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fb0ba3dc-6f9d-4cca-b49f-2e90b1f5a44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:33.279815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ba3dc-6f9d-4cca-b49f-2e90b1f5a44f None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:33.283341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30fe6f-29d0-4187-810d-7b52dd2942cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:33.283979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30fe6f-29d0-4187-810d-7b52dd2942cd service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:33.284266 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30fe6f-29d0-4187-810d-7b52dd2942cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:33.284545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30fe6f-29d0-4187-810d-7b52dd2942cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:33.345897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30fe6f-29d0-4187-810d-7b52dd2942cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:33.347387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30fe6f-29d0-4187-810d-7b52dd2942cd service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:33.356893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 936/1868] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:34.161860 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505487d1-f125-4683-a10b-89e63e15a1a6 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:34.162357 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505487d1-f125-4683-a10b-89e63e15a1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:34.162455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505487d1-f125-4683-a10b-89e63e15a1a6 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:34.164797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 933/1869] 10.222.0.79 () {54 vars in 921 bytes} [Mon Feb 21 01:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:38:34.173584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286a9e2-9da2-4d1f-9998-6428c9ed85c2 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:34.174057 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286a9e2-9da2-4d1f-9998-6428c9ed85c2 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:34.174162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286a9e2-9da2-4d1f-9998-6428c9ed85c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:34.229621 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-2286a9e2-9da2-4d1f-9998-6428c9ed85c2 None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:34.231194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-2286a9e2-9da2-4d1f-9998-6428c9ed85c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:34.340172 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 937/1870] 10.222.0.79 () {58 vars in 1018 bytes} [Mon Feb 21 01:38:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:34.453082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505487d1-f125-4683-a10b-89e63e15a1a6 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:34.454991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-505487d1-f125-4683-a10b-89e63e15a1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:34.472606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505487d1-f125-4683-a10b-89e63e15a1a6 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:34.478615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e9742-e7b3-4014-971f-4a32e36ba8b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:34.479255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e9742-e7b3-4014-971f-4a32e36ba8b6 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:34.479541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e9742-e7b3-4014-971f-4a32e36ba8b6 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:34.479817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e9742-e7b3-4014-971f-4a32e36ba8b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:34.488443 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e9742-e7b3-4014-971f-4a32e36ba8b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:34.490008 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e9742-e7b3-4014-971f-4a32e36ba8b6 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:34.500903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 934/1871] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:37.509192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286a9e2-9da2-4d1f-9998-6428c9ed85c2 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:37.510995 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-2286a9e2-9da2-4d1f-9998-6428c9ed85c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:37.606478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286a9e2-9da2-4d1f-9998-6428c9ed85c2 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:37.613643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:37.615327 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:37.615822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:37.617274 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] PATH_INFO: `/v3/users/dd6b2823c0244b5897697de650b6da5b` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:37.621139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6b2823c0244b5897697de650b6da5b)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:37.624005 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:37.691178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6b2823c0244b5897697de650b6da5b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:37.702440 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6b2823c0244b5897697de650b6da5b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:37.719566 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6b2823c0244b5897697de650b6da5b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:37.720294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6b2823c0244b5897697de650b6da5b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:37.730548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6b2823c0244b5897697de650b6da5b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:37.740840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 938/1872] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:37 2022] DELETE /identity/v3/users/dd6b2823c0244b5897697de650b6da5b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:37.745837 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5e49f-f2c1-4e7d-a104-a7608f3ec20f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:37.746354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5e49f-f2c1-4e7d-a104-a7608f3ec20f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:37.746441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5e49f-f2c1-4e7d-a104-a7608f3ec20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:37.766514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-91b5e49f-f2c1-4e7d-a104-a7608f3ec20f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:37.767846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-91b5e49f-f2c1-4e7d-a104-a7608f3ec20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:37.832991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 935/1873] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:37.843903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:37.845552 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:37.906455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fb336-0e5a-4981-9494-bc81155bfec2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:37.910105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43509a2-15b1-4966-87ea-275db549cb95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:37.910795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43509a2-15b1-4966-87ea-275db549cb95 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:37.911080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43509a2-15b1-4966-87ea-275db549cb95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:37.911353 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43509a2-15b1-4966-87ea-275db549cb95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:37.921192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43509a2-15b1-4966-87ea-275db549cb95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:37.922666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43509a2-15b1-4966-87ea-275db549cb95 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:37.937238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 939/1874] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:38.283611 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5e49f-f2c1-4e7d-a104-a7608f3ec20f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:38.285244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-91b5e49f-f2c1-4e7d-a104-a7608f3ec20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:38.297772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5e49f-f2c1-4e7d-a104-a7608f3ec20f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:38.304619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:38.305492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.306309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.306743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] PATH_INFO: `/v3/projects/af325ba678c34d8ca8829f4f05194df7` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.307956 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af325ba678c34d8ca8829f4f05194df7)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:38.309872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:38.379431 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af325ba678c34d8ca8829f4f05194df7', 'request_id': 'req-8f3c18cd-d3b8-4138-becd-b49163be2da1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:38.385449 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af325ba678c34d8ca8829f4f05194df7', 'request_id': 'req-8f3c18cd-d3b8-4138-becd-b49163be2da1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:38.393922 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af325ba678c34d8ca8829f4f05194df7', 'request_id': 'req-8f3c18cd-d3b8-4138-becd-b49163be2da1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:38.404839 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] The token cache is being invalidate because project af325ba678c34d8ca8829f4f05194df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:38.405124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:38.405744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:38.407292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 936/1875] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:38 2022] DELETE /identity/v3/projects/af325ba678c34d8ca8829f4f05194df7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:38.412026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe72142-4225-4b4a-aad8-cc61b1308b2f None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.412315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe72142-4225-4b4a-aad8-cc61b1308b2f None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.412590 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe72142-4225-4b4a-aad8-cc61b1308b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.430009 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-dbe72142-4225-4b4a-aad8-cc61b1308b2f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:38.431218 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-dbe72142-4225-4b4a-aad8-cc61b1308b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:38.485082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:38.486458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:38.488241 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 940/1876] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:38.496766 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117de296-4089-468c-9dea-a5caaa1473d0 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.497053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117de296-4089-468c-9dea-a5caaa1473d0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.497331 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117de296-4089-468c-9dea-a5caaa1473d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.500618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c18cd-d3b8-4138-becd-b49163be2da1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:38.505641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6801b7a-0fe9-48c3-a9d3-b90c7c7ebeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:38.506647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6801b7a-0fe9-48c3-a9d3-b90c7c7ebeec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.506979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6801b7a-0fe9-48c3-a9d3-b90c7c7ebeec admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.507301 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6801b7a-0fe9-48c3-a9d3-b90c7c7ebeec admin admin] PATH_INFO: `/v3/users/87dfb858cd7c450faa19405aa4f1ecf1` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.508533 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6801b7a-0fe9-48c3-a9d3-b90c7c7ebeec admin admin] RBAC: Authorizing `identity:delete_user(user_id=87dfb858cd7c450faa19405aa4f1ecf1)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:38.510502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6801b7a-0fe9-48c3-a9d3-b90c7c7ebeec admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:38.515158 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-117de296-4089-468c-9dea-a5caaa1473d0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:38.516324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-117de296-4089-468c-9dea-a5caaa1473d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:38.525093 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 941/1877] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:38.530044 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117de296-4089-468c-9dea-a5caaa1473d0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:38.539931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117de296-4089-468c-9dea-a5caaa1473d0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:38.544902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b5856-8387-46b7-9dcd-fac5420aa5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:38.545546 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b5856-8387-46b7-9dcd-fac5420aa5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.545829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b5856-8387-46b7-9dcd-fac5420aa5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.546108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b5856-8387-46b7-9dcd-fac5420aa5f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.546867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b5856-8387-46b7-9dcd-fac5420aa5f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:38.547174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b5856-8387-46b7-9dcd-fac5420aa5f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:38.548766 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b5856-8387-46b7-9dcd-fac5420aa5f3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:38.557562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b6801b7a-0fe9-48c3-a9d3-b90c7c7ebeec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87dfb858cd7c450faa19405aa4f1ecf1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:38.560207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 942/1878] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:38:38.564383 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b5856-8387-46b7-9dcd-fac5420aa5f3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:38.564632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b6801b7a-0fe9-48c3-a9d3-b90c7c7ebeec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87dfb858cd7c450faa19405aa4f1ecf1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:38.574857 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b5856-8387-46b7-9dcd-fac5420aa5f3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:38.576973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b6801b7a-0fe9-48c3-a9d3-b90c7c7ebeec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87dfb858cd7c450faa19405aa4f1ecf1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:38.577703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b6801b7a-0fe9-48c3-a9d3-b90c7c7ebeec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87dfb858cd7c450faa19405aa4f1ecf1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:38.578364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b6801b7a-0fe9-48c3-a9d3-b90c7c7ebeec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87dfb858cd7c450faa19405aa4f1ecf1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:38.580130 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120a340-3c9c-495d-b2f4-8236e61cfa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:38.580827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120a340-3c9c-495d-b2f4-8236e61cfa1f admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.581157 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120a340-3c9c-495d-b2f4-8236e61cfa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.581435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120a340-3c9c-495d-b2f4-8236e61cfa1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.582125 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120a340-3c9c-495d-b2f4-8236e61cfa1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:38.584251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120a340-3c9c-495d-b2f4-8236e61cfa1f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:38.591901 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 937/1879] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:38 2022] DELETE /identity/v3/users/87dfb858cd7c450faa19405aa4f1ecf1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:38.596208 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3f5f5-c32f-4a93-ac54-4716a04f6bdb None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.596495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3f5f5-c32f-4a93-ac54-4716a04f6bdb None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.596773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3f5f5-c32f-4a93-ac54-4716a04f6bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.610948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 943/1880] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:38 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:38:38.614421 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-6aa3f5f5-c32f-4a93-ac54-4716a04f6bdb None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:38.615035 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120a340-3c9c-495d-b2f4-8236e61cfa1f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:38.615616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6aa3f5f5-c32f-4a93-ac54-4716a04f6bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:38.616700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3120a340-3c9c-495d-b2f4-8236e61cfa1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:38.677231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 938/1881] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:38.687251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3f5f5-c32f-4a93-ac54-4716a04f6bdb None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:38.688456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120a340-3c9c-495d-b2f4-8236e61cfa1f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:38.688723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6aa3f5f5-c32f-4a93-ac54-4716a04f6bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:38.695947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25560b7b-2550-47e2-ba5c-d93d10c155a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:38.696636 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25560b7b-2550-47e2-ba5c-d93d10c155a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.696922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25560b7b-2550-47e2-ba5c-d93d10c155a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.697233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25560b7b-2550-47e2-ba5c-d93d10c155a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.697927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25560b7b-2550-47e2-ba5c-d93d10c155a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:38.700215 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25560b7b-2550-47e2-ba5c-d93d10c155a2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:38.726228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 944/1882] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:38 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:38:38.730506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25560b7b-2550-47e2-ba5c-d93d10c155a2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:38.746666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25560b7b-2550-47e2-ba5c-d93d10c155a2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:38.751322 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5dd48-be72-4357-95d2-a3433c3127bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:38.751996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5dd48-be72-4357-95d2-a3433c3127bc admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.752282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5dd48-be72-4357-95d2-a3433c3127bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.752556 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5dd48-be72-4357-95d2-a3433c3127bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.753382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5dd48-be72-4357-95d2-a3433c3127bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:38.755036 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5dd48-be72-4357-95d2-a3433c3127bc admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:38.755138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3f5f5-c32f-4a93-ac54-4716a04f6bdb None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:38.759360 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457ac1d-d7b1-475b-8742-ebf2e3736217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:38.760094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457ac1d-d7b1-475b-8742-ebf2e3736217 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.760378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457ac1d-d7b1-475b-8742-ebf2e3736217 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.760650 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457ac1d-d7b1-475b-8742-ebf2e3736217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.766827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 945/1883] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:38:38.770727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5dd48-be72-4357-95d2-a3433c3127bc admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:38.774574 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457ac1d-d7b1-475b-8742-ebf2e3736217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:38.776155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457ac1d-d7b1-475b-8742-ebf2e3736217 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:38.783334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5dd48-be72-4357-95d2-a3433c3127bc admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:38.786465 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 939/1884] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:38.794964 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555185a6-0f25-4ab8-ad38-20c6dcec38a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:38.795741 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555185a6-0f25-4ab8-ad38-20c6dcec38a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.796092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555185a6-0f25-4ab8-ad38-20c6dcec38a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.796378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555185a6-0f25-4ab8-ad38-20c6dcec38a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.797116 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555185a6-0f25-4ab8-ad38-20c6dcec38a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:38.798785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555185a6-0f25-4ab8-ad38-20c6dcec38a5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:38.813574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 946/1885] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:38:38.815423 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457ac1d-d7b1-475b-8742-ebf2e3736217 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:38.828944 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457ac1d-d7b1-475b-8742-ebf2e3736217 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:38.836153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a5bd6-8de0-42c7-a8dc-6eeb9084da24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:38.837074 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a5bd6-8de0-42c7-a8dc-6eeb9084da24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.837357 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a5bd6-8de0-42c7-a8dc-6eeb9084da24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.837638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a5bd6-8de0-42c7-a8dc-6eeb9084da24 admin admin] PATH_INFO: `/v3/projects/63648c8ea63247f193e2960e919fa19e/users/378b4736a92149c29e756f850d53987d/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.869383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a5bd6-8de0-42c7-a8dc-6eeb9084da24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63648c8ea63247f193e2960e919fa19e, user_id=378b4736a92149c29e756f850d53987d, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:38.874809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a5bd6-8de0-42c7-a8dc-6eeb9084da24 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:38.894118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 940/1886] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:38 2022] PUT /identity/v3/projects/63648c8ea63247f193e2960e919fa19e/users/378b4736a92149c29e756f850d53987d/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:38.905720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a86eb-707c-4916-8f5a-46afcc99849c None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:38.906086 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a86eb-707c-4916-8f5a-46afcc99849c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:38.906496 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a86eb-707c-4916-8f5a-46afcc99849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:38.947320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a91a86eb-707c-4916-8f5a-46afcc99849c None None] MFA Rules not processed for user `378b4736a92149c29e756f850d53987d`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:38.949202 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a91a86eb-707c-4916-8f5a-46afcc99849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:39.050238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 947/1887] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:39.060836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a5bd6-8de0-42c7-a8dc-6eeb9084da24 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:39.064265 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-559a5bd6-8de0-42c7-a8dc-6eeb9084da24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:39.140942 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a86eb-707c-4916-8f5a-46afcc99849c None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:39.142543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a91a86eb-707c-4916-8f5a-46afcc99849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:39.149455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a5bd6-8de0-42c7-a8dc-6eeb9084da24 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:39.155617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4462044-7199-4d60-baab-a657a05200f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:39.159159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4462044-7199-4d60-baab-a657a05200f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:39.159159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4462044-7199-4d60-baab-a657a05200f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:39.159372 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4462044-7199-4d60-baab-a657a05200f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:39.185862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4462044-7199-4d60-baab-a657a05200f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:39.187323 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4462044-7199-4d60-baab-a657a05200f3 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:39.197698 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 941/1888] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:39.199851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4462044-7199-4d60-baab-a657a05200f3 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:39.220218 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b4462044-7199-4d60-baab-a657a05200f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:39.230987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a86eb-707c-4916-8f5a-46afcc99849c None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:39.238563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8837b-ee90-4e5d-8403-a3f33304ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:39.239742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8837b-ee90-4e5d-8403-a3f33304ffc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:39.240125 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8837b-ee90-4e5d-8403-a3f33304ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:39.240497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8837b-ee90-4e5d-8403-a3f33304ffc1 admin admin] PATH_INFO: `/v3/users/bc9983f861e849f5b668ccf0c4025b86` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:39.243231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8837b-ee90-4e5d-8403-a3f33304ffc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9983f861e849f5b668ccf0c4025b86)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:39.246040 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8837b-ee90-4e5d-8403-a3f33304ffc1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:39.255310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4462044-7199-4d60-baab-a657a05200f3 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:39.263145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63656fc8-08ce-4932-a1dd-bbef72a022e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:39.265879 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63656fc8-08ce-4932-a1dd-bbef72a022e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:39.266582 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63656fc8-08ce-4932-a1dd-bbef72a022e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:39.267632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63656fc8-08ce-4932-a1dd-bbef72a022e6 admin admin] PATH_INFO: `/v3/projects/4bff7bcbc47346149ba078443d06c80d` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:39.270117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63656fc8-08ce-4932-a1dd-bbef72a022e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bff7bcbc47346149ba078443d06c80d)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:39.275640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63656fc8-08ce-4932-a1dd-bbef72a022e6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:39.360552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-63656fc8-08ce-4932-a1dd-bbef72a022e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bff7bcbc47346149ba078443d06c80d', 'request_id': 'req-63656fc8-08ce-4932-a1dd-bbef72a022e6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:39.367634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3da8837b-ee90-4e5d-8403-a3f33304ffc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9983f861e849f5b668ccf0c4025b86'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:39.373276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-63656fc8-08ce-4932-a1dd-bbef72a022e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bff7bcbc47346149ba078443d06c80d', 'request_id': 'req-63656fc8-08ce-4932-a1dd-bbef72a022e6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:39.380892 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3da8837b-ee90-4e5d-8403-a3f33304ffc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9983f861e849f5b668ccf0c4025b86'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:39.403082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-63656fc8-08ce-4932-a1dd-bbef72a022e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bff7bcbc47346149ba078443d06c80d', 'request_id': 'req-63656fc8-08ce-4932-a1dd-bbef72a022e6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:39.423371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3da8837b-ee90-4e5d-8403-a3f33304ffc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9983f861e849f5b668ccf0c4025b86'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:39.424264 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3da8837b-ee90-4e5d-8403-a3f33304ffc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9983f861e849f5b668ccf0c4025b86'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:39.426730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-63656fc8-08ce-4932-a1dd-bbef72a022e6 admin admin] The token cache is being invalidate because project 4bff7bcbc47346149ba078443d06c80d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:39.427699 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-63656fc8-08ce-4932-a1dd-bbef72a022e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:39.429819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-63656fc8-08ce-4932-a1dd-bbef72a022e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:39.434239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 942/1889] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:39 2022] DELETE /identity/v3/projects/4bff7bcbc47346149ba078443d06c80d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:39.439063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaad63-136c-438d-b004-4efdde31286b None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:39.439440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaad63-136c-438d-b004-4efdde31286b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:39.439803 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaad63-136c-438d-b004-4efdde31286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:39.440414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3da8837b-ee90-4e5d-8403-a3f33304ffc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9983f861e849f5b668ccf0c4025b86'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:39.458546 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 948/1890] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:39 2022] DELETE /identity/v3/users/bc9983f861e849f5b668ccf0c4025b86 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:39.462591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8eade-17af-495b-9cb4-5f0119ef8e89 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:39.462885 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8eade-17af-495b-9cb4-5f0119ef8e89 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:39.467499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8eade-17af-495b-9cb4-5f0119ef8e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:39.505418 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-19aaad63-136c-438d-b004-4efdde31286b None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:39.506222 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-0ba8eade-17af-495b-9cb4-5f0119ef8e89 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:39.507551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-19aaad63-136c-438d-b004-4efdde31286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:39.508902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0ba8eade-17af-495b-9cb4-5f0119ef8e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:39.613975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 943/1891] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:39.623893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8baf0-bf3b-4609-98b0-e157331d170b None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:39.624191 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8baf0-bf3b-4609-98b0-e157331d170b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:39.624477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8baf0-bf3b-4609-98b0-e157331d170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:39.654939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 949/1892] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:39.671312 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8eade-17af-495b-9cb4-5f0119ef8e89 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:39.672044 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-dfc8baf0-bf3b-4609-98b0-e157331d170b None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:39.673427 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0ba8eade-17af-495b-9cb4-5f0119ef8e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:39.675259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-dfc8baf0-bf3b-4609-98b0-e157331d170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:39.691903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 944/1893] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:39.696226 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8baf0-bf3b-4609-98b0-e157331d170b None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:39.717612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8baf0-bf3b-4609-98b0-e157331d170b None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:39.729278 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9582-ef58-4c48-8294-49274a3e69e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:39.730048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9582-ef58-4c48-8294-49274a3e69e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:39.730456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9582-ef58-4c48-8294-49274a3e69e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:39.731399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9582-ef58-4c48-8294-49274a3e69e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:39.744092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff9582-ef58-4c48-8294-49274a3e69e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:39.744092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff9582-ef58-4c48-8294-49274a3e69e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:39.744092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff9582-ef58-4c48-8294-49274a3e69e4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:39.762956 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 945/1894] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:39.767150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9582-ef58-4c48-8294-49274a3e69e4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:39.767855 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8eade-17af-495b-9cb4-5f0119ef8e89 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:39.779329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f182eb-9459-4afb-b86e-22a988096be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:39.780743 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f182eb-9459-4afb-b86e-22a988096be5 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:39.781177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f182eb-9459-4afb-b86e-22a988096be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:39.782275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f182eb-9459-4afb-b86e-22a988096be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:39.782905 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9582-ef58-4c48-8294-49274a3e69e4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:39.790108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9898de9-33bc-4a2d-a446-66e51f9e4bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:39.790858 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9898de9-33bc-4a2d-a446-66e51f9e4bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:39.791208 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9898de9-33bc-4a2d-a446-66e51f9e4bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:39.791459 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9898de9-33bc-4a2d-a446-66e51f9e4bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:39.792205 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9898de9-33bc-4a2d-a446-66e51f9e4bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:39.794536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9898de9-33bc-4a2d-a446-66e51f9e4bb3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:39.795491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f182eb-9459-4afb-b86e-22a988096be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:39.797040 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f182eb-9459-4afb-b86e-22a988096be5 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:39.809918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 950/1895] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:38:39.810817 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f182eb-9459-4afb-b86e-22a988096be5 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:39.812133 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-05f182eb-9459-4afb-b86e-22a988096be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:39.837705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f182eb-9459-4afb-b86e-22a988096be5 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:39.841954 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 946/1896] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:39 2022] POST /identity/v3/projects => generated 401 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:39.846396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9898de9-33bc-4a2d-a446-66e51f9e4bb3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:39.920174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ea698-67ad-4c83-8de8-8f50824d2e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:39.921063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ea698-67ad-4c83-8de8-8f50824d2e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:39.921338 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ea698-67ad-4c83-8de8-8f50824d2e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:39.921608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ea698-67ad-4c83-8de8-8f50824d2e7c admin admin] PATH_INFO: `/v3/users/215d92a8b22b456384c45dc281bea574` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:39.923008 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ea698-67ad-4c83-8de8-8f50824d2e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=215d92a8b22b456384c45dc281bea574)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:39.924931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ea698-67ad-4c83-8de8-8f50824d2e7c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:39.942435 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9898de9-33bc-4a2d-a446-66e51f9e4bb3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:39.947243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785bc4c-c089-4ae2-b76b-335cd8600c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:39.947912 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785bc4c-c089-4ae2-b76b-335cd8600c3b admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:39.948193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785bc4c-c089-4ae2-b76b-335cd8600c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:39.948462 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785bc4c-c089-4ae2-b76b-335cd8600c3b admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:39.949256 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785bc4c-c089-4ae2-b76b-335cd8600c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:39.951348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785bc4c-c089-4ae2-b76b-335cd8600c3b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:39.974870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 947/1897] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:39 2022] POST /identity/v3/users => generated 301 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:39.979582 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785bc4c-c089-4ae2-b76b-335cd8600c3b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:39.980767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-614ea698-67ad-4c83-8de8-8f50824d2e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215d92a8b22b456384c45dc281bea574'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:39.993081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785bc4c-c089-4ae2-b76b-335cd8600c3b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:39.996351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-614ea698-67ad-4c83-8de8-8f50824d2e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215d92a8b22b456384c45dc281bea574'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:39.998705 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41682c85-c1a2-4e50-887c-eea8d76ccec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:39.999450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41682c85-c1a2-4e50-887c-eea8d76ccec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:39.999799 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41682c85-c1a2-4e50-887c-eea8d76ccec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:40.000250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41682c85-c1a2-4e50-887c-eea8d76ccec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:40.001172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41682c85-c1a2-4e50-887c-eea8d76ccec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:40.003108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41682c85-c1a2-4e50-887c-eea8d76ccec3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:40.012279 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-614ea698-67ad-4c83-8de8-8f50824d2e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215d92a8b22b456384c45dc281bea574'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.013076 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-614ea698-67ad-4c83-8de8-8f50824d2e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215d92a8b22b456384c45dc281bea574'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.017098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 948/1898] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:38:40.019958 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-614ea698-67ad-4c83-8de8-8f50824d2e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215d92a8b22b456384c45dc281bea574'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.021490 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41682c85-c1a2-4e50-887c-eea8d76ccec3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:40.024132 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-41682c85-c1a2-4e50-887c-eea8d76ccec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:40.027416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 951/1899] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:39 2022] DELETE /identity/v3/users/215d92a8b22b456384c45dc281bea574 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:40.031891 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6779249-b8c8-46b1-951d-4559d022081a None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:40.032336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6779249-b8c8-46b1-951d-4559d022081a None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:40.032679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6779249-b8c8-46b1-951d-4559d022081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:40.039143 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41682c85-c1a2-4e50-887c-eea8d76ccec3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:40.051087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-f6779249-b8c8-46b1-951d-4559d022081a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:40.052276 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f6779249-b8c8-46b1-951d-4559d022081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:40.124094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dba9f0-d05e-47fb-a290-9aa76124b025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:40.125186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dba9f0-d05e-47fb-a290-9aa76124b025 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:40.125186 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dba9f0-d05e-47fb-a290-9aa76124b025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:40.125456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dba9f0-d05e-47fb-a290-9aa76124b025 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:40.126123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dba9f0-d05e-47fb-a290-9aa76124b025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:40.127939 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dba9f0-d05e-47fb-a290-9aa76124b025 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:40.139466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 949/1900] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:40.143707 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dba9f0-d05e-47fb-a290-9aa76124b025 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:40.145506 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-06dba9f0-d05e-47fb-a290-9aa76124b025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:40.165561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dba9f0-d05e-47fb-a290-9aa76124b025 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:40.167224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 952/1901] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:40.167849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6779249-b8c8-46b1-951d-4559d022081a None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:40.174608 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716e8be-2760-4664-9f89-447eafe060fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:40.175474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716e8be-2760-4664-9f89-447eafe060fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:40.176229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716e8be-2760-4664-9f89-447eafe060fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:40.176229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716e8be-2760-4664-9f89-447eafe060fc admin admin] PATH_INFO: `/v3/projects/0733dc50faf9453790f66aea27b8b3f8` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:40.177259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716e8be-2760-4664-9f89-447eafe060fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0733dc50faf9453790f66aea27b8b3f8)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:40.177416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6779249-b8c8-46b1-951d-4559d022081a None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:40.179702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716e8be-2760-4664-9f89-447eafe060fc admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:40.182499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfab29d-5127-493b-a18d-5063a80669e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:40.183460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfab29d-5127-493b-a18d-5063a80669e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:40.183672 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfab29d-5127-493b-a18d-5063a80669e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:40.184493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfab29d-5127-493b-a18d-5063a80669e1 admin admin] PATH_INFO: `/v3/projects/2aa705a6a2b64f3a9dbcd2c22b53f813/users/d8edd2ec587540698c3743ad043da805/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:40.207985 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfab29d-5127-493b-a18d-5063a80669e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa705a6a2b64f3a9dbcd2c22b53f813, user_id=d8edd2ec587540698c3743ad043da805, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:40.211752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfab29d-5127-493b-a18d-5063a80669e1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:40.229761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 953/1902] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:40 2022] PUT /identity/v3/projects/2aa705a6a2b64f3a9dbcd2c22b53f813/users/d8edd2ec587540698c3743ad043da805/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:40.230622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfab29d-5127-493b-a18d-5063a80669e1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:40.242315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3bfab29d-5127-493b-a18d-5063a80669e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:40.253900 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c716e8be-2760-4664-9f89-447eafe060fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0733dc50faf9453790f66aea27b8b3f8', 'request_id': 'req-c716e8be-2760-4664-9f89-447eafe060fc'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.261259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c716e8be-2760-4664-9f89-447eafe060fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0733dc50faf9453790f66aea27b8b3f8', 'request_id': 'req-c716e8be-2760-4664-9f89-447eafe060fc'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.270303 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c716e8be-2760-4664-9f89-447eafe060fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0733dc50faf9453790f66aea27b8b3f8', 'request_id': 'req-c716e8be-2760-4664-9f89-447eafe060fc'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.282765 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c716e8be-2760-4664-9f89-447eafe060fc admin admin] The token cache is being invalidate because project 0733dc50faf9453790f66aea27b8b3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:40.283092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c716e8be-2760-4664-9f89-447eafe060fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.284215 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c716e8be-2760-4664-9f89-447eafe060fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.287263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 950/1903] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:40 2022] DELETE /identity/v3/projects/0733dc50faf9453790f66aea27b8b3f8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:40.290918 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f61b2-6981-4cda-b72a-0f2f3e8f5c1d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:40.290918 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f61b2-6981-4cda-b72a-0f2f3e8f5c1d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:40.290918 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f61b2-6981-4cda-b72a-0f2f3e8f5c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:40.325611 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-3d3f61b2-6981-4cda-b72a-0f2f3e8f5c1d None None] MFA Rules not processed for user `d8edd2ec587540698c3743ad043da805`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:40.326997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3d3f61b2-6981-4cda-b72a-0f2f3e8f5c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:40.327260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfab29d-5127-493b-a18d-5063a80669e1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:40.379179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c0369-320b-43eb-8639-258ef9568f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:40.380248 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c0369-320b-43eb-8639-258ef9568f57 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:40.380603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c0369-320b-43eb-8639-258ef9568f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:40.380880 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c0369-320b-43eb-8639-258ef9568f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:40.383630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e21c0369-320b-43eb-8639-258ef9568f57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:40.395948 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 951/1904] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:40.400117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f61b2-6981-4cda-b72a-0f2f3e8f5c1d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:40.401479 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3d3f61b2-6981-4cda-b72a-0f2f3e8f5c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:40.459146 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c0369-320b-43eb-8639-258ef9568f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:40.461444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c0369-320b-43eb-8639-258ef9568f57 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:40.469964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f61b2-6981-4cda-b72a-0f2f3e8f5c1d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:40.471630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 954/1905] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:40.472298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c0369-320b-43eb-8639-258ef9568f57 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:40.474067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e21c0369-320b-43eb-8639-258ef9568f57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:40.475675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:40.476807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:40.477106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:40.477423 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] PATH_INFO: `/v3/users/88f6085cce6a45bdb4113992850540c4` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:40.478821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f6085cce6a45bdb4113992850540c4)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:40.480915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:40.485785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c0369-320b-43eb-8639-258ef9568f57 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:40.493141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ecd5e-0782-46ef-b2a3-c9bd53494e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:40.494795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ecd5e-0782-46ef-b2a3-c9bd53494e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:40.495159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ecd5e-0782-46ef-b2a3-c9bd53494e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:40.495557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ecd5e-0782-46ef-b2a3-c9bd53494e47 admin admin] PATH_INFO: `/v3/users/d3eb63f8ecb64366a18d5e909aef0837` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:40.496984 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ecd5e-0782-46ef-b2a3-c9bd53494e47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3eb63f8ecb64366a18d5e909aef0837)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:40.499595 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ecd5e-0782-46ef-b2a3-c9bd53494e47 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:40.550556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f6085cce6a45bdb4113992850540c4'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.562088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f6085cce6a45bdb4113992850540c4'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.578335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f6085cce6a45bdb4113992850540c4'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.579098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f6085cce6a45bdb4113992850540c4'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.579968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f6085cce6a45bdb4113992850540c4'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.594289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-200ecd5e-0782-46ef-b2a3-c9bd53494e47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3eb63f8ecb64366a18d5e909aef0837'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.604759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 952/1906] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:40 2022] DELETE /identity/v3/users/88f6085cce6a45bdb4113992850540c4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:40.604759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:40.604759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:40.608964 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-200ecd5e-0782-46ef-b2a3-c9bd53494e47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3eb63f8ecb64366a18d5e909aef0837'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.629679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-200ecd5e-0782-46ef-b2a3-c9bd53494e47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3eb63f8ecb64366a18d5e909aef0837'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.632413 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-200ecd5e-0782-46ef-b2a3-c9bd53494e47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3eb63f8ecb64366a18d5e909aef0837'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.645555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-200ecd5e-0782-46ef-b2a3-c9bd53494e47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3eb63f8ecb64366a18d5e909aef0837'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:40.662816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 955/1907] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:40 2022] DELETE /identity/v3/users/d3eb63f8ecb64366a18d5e909aef0837 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:40.664492 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697eb9-7868-41bf-9bea-9b6ac7d6b8d1 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:40.664788 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697eb9-7868-41bf-9bea-9b6ac7d6b8d1 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:40.665250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697eb9-7868-41bf-9bea-9b6ac7d6b8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:40.685166 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-54697eb9-7868-41bf-9bea-9b6ac7d6b8d1 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:40.686770 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-54697eb9-7868-41bf-9bea-9b6ac7d6b8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:40.713870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189378-6550-4551-8c82-0c1dd27f6391 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:40.755884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 956/1908] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:40.804331 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54697eb9-7868-41bf-9bea-9b6ac7d6b8d1 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:40.805812 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-54697eb9-7868-41bf-9bea-9b6ac7d6b8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:40.835183 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83c204-b6d9-4d1b-bf51-6e3f8ea13978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:40.835961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83c204-b6d9-4d1b-bf51-6e3f8ea13978 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:40.836368 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83c204-b6d9-4d1b-bf51-6e3f8ea13978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:40.836707 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83c204-b6d9-4d1b-bf51-6e3f8ea13978 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:40.837538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83c204-b6d9-4d1b-bf51-6e3f8ea13978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:40.840494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83c204-b6d9-4d1b-bf51-6e3f8ea13978 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:40.891052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54697eb9-7868-41bf-9bea-9b6ac7d6b8d1 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:40.895259 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39efbad-b248-48b1-b473-3d77f3209103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:40.896096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39efbad-b248-48b1-b473-3d77f3209103 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:40.896490 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39efbad-b248-48b1-b473-3d77f3209103 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:40.896840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39efbad-b248-48b1-b473-3d77f3209103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:40.900243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 953/1909] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:40 2022] POST /identity/v3/projects => generated 399 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:40.904475 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83c204-b6d9-4d1b-bf51-6e3f8ea13978 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:40.906138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ce83c204-b6d9-4d1b-bf51-6e3f8ea13978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:40.917124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39efbad-b248-48b1-b473-3d77f3209103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:40.922414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39efbad-b248-48b1-b473-3d77f3209103 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:40.955953 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 957/1910] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:38:41.020610 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83c204-b6d9-4d1b-bf51-6e3f8ea13978 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:41.027196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b8c43-470f-43b4-b068-22d488917280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:41.027923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b8c43-470f-43b4-b068-22d488917280 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.028311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b8c43-470f-43b4-b068-22d488917280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.028595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b8c43-470f-43b4-b068-22d488917280 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.029402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b8c43-470f-43b4-b068-22d488917280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:41.031539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b8c43-470f-43b4-b068-22d488917280 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:41.064262 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 954/1911] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:40 2022] POST /identity/v3/users => generated 306 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:38:41.069370 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39efbad-b248-48b1-b473-3d77f3209103 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:41.082457 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39efbad-b248-48b1-b473-3d77f3209103 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:41.093110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376ad76-264a-412c-9f68-73f133104865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:41.094029 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ad76-264a-412c-9f68-73f133104865 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.094417 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ad76-264a-412c-9f68-73f133104865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.094742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ad76-264a-412c-9f68-73f133104865 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.095573 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376ad76-264a-412c-9f68-73f133104865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:41.097268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376ad76-264a-412c-9f68-73f133104865 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:41.109155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b8c43-470f-43b4-b068-22d488917280 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:41.111892 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8b2b8c43-470f-43b4-b068-22d488917280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:41.119489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 958/1912] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:41.120721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376ad76-264a-412c-9f68-73f133104865 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:41.130407 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b8c43-470f-43b4-b068-22d488917280 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:41.133197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376ad76-264a-412c-9f68-73f133104865 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:41.138688 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:41.139678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.139970 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.140250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] PATH_INFO: `/v3/projects/4e728b09525741f1810074c72d2af8eb` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.141210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927d64b-2301-4634-af05-ad3416c2798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:41.142359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e728b09525741f1810074c72d2af8eb)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:41.142863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927d64b-2301-4634-af05-ad3416c2798f admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.143461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927d64b-2301-4634-af05-ad3416c2798f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.143943 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927d64b-2301-4634-af05-ad3416c2798f admin admin] PATH_INFO: `/v3/projects/0361212d89bd4222a0dd54b8172161c0/users/66447d6a788b40f68d98cc6049e1116f/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.144663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:41.169049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927d64b-2301-4634-af05-ad3416c2798f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0361212d89bd4222a0dd54b8172161c0, user_id=66447d6a788b40f68d98cc6049e1116f, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:41.172930 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927d64b-2301-4634-af05-ad3416c2798f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:41.226832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 959/1913] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:41 2022] PUT /identity/v3/projects/0361212d89bd4222a0dd54b8172161c0/users/66447d6a788b40f68d98cc6049e1116f/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:41.230617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927d64b-2301-4634-af05-ad3416c2798f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:41.235024 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6927d64b-2301-4634-af05-ad3416c2798f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:41.249626 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e728b09525741f1810074c72d2af8eb', 'request_id': 'req-c61bd91e-fca4-4d45-923a-43bf16f286e1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.260494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e728b09525741f1810074c72d2af8eb', 'request_id': 'req-c61bd91e-fca4-4d45-923a-43bf16f286e1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.270493 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e728b09525741f1810074c72d2af8eb', 'request_id': 'req-c61bd91e-fca4-4d45-923a-43bf16f286e1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.284896 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] The token cache is being invalidate because project 4e728b09525741f1810074c72d2af8eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:41.285083 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.285844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.291048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 955/1914] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:41 2022] DELETE /identity/v3/projects/4e728b09525741f1810074c72d2af8eb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:41.291764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:41.293250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:41.328958 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927d64b-2301-4634-af05-ad3416c2798f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:41.378331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bd91e-fca4-4d45-923a-43bf16f286e1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:41.384219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad90d4-2d2b-4adc-888a-20e80fed8fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:41.384889 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad90d4-2d2b-4adc-888a-20e80fed8fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.385176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad90d4-2d2b-4adc-888a-20e80fed8fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.385454 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad90d4-2d2b-4adc-888a-20e80fed8fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.386191 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad90d4-2d2b-4adc-888a-20e80fed8fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:41.387852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad90d4-2d2b-4adc-888a-20e80fed8fa5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:41.392813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:41.393686 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.394017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.394320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] PATH_INFO: `/v3/projects/46ef23eca5874ea396384b5e5f544cbe` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.395553 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ef23eca5874ea396384b5e5f544cbe)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:41.397577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:41.400032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 956/1915] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:41.400868 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad90d4-2d2b-4adc-888a-20e80fed8fa5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:41.402613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9dad90d4-2d2b-4adc-888a-20e80fed8fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:41.415515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad90d4-2d2b-4adc-888a-20e80fed8fa5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:41.420260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:41.421145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.421431 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.421708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] PATH_INFO: `/v3/users/95ff0036c1244de9b49b8f2ce85cffee` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.422928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ff0036c1244de9b49b8f2ce85cffee)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:41.424845 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:41.459893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ef23eca5874ea396384b5e5f544cbe', 'request_id': 'req-38de8653-73ca-4944-bf7f-4074f8b2f719'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.465672 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ef23eca5874ea396384b5e5f544cbe', 'request_id': 'req-38de8653-73ca-4944-bf7f-4074f8b2f719'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.474854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ef23eca5874ea396384b5e5f544cbe', 'request_id': 'req-38de8653-73ca-4944-bf7f-4074f8b2f719'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.478857 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ff0036c1244de9b49b8f2ce85cffee'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.486243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ff0036c1244de9b49b8f2ce85cffee'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.495515 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] The token cache is being invalidate because project 46ef23eca5874ea396384b5e5f544cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:41.495815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.496686 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.498507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 960/1916] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:41 2022] DELETE /identity/v3/projects/46ef23eca5874ea396384b5e5f544cbe => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:41.499004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:41.500334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:41.503504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ff0036c1244de9b49b8f2ce85cffee'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.504254 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ff0036c1244de9b49b8f2ce85cffee'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.504876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ff0036c1244de9b49b8f2ce85cffee'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.518665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 957/1917] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:41 2022] DELETE /identity/v3/users/95ff0036c1244de9b49b8f2ce85cffee => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:41.522421 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:41.523797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:41.566252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de8653-73ca-4944-bf7f-4074f8b2f719 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:41.590079 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00462-3a4e-4bba-b091-88d797d09fb2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:41.595431 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9aeb6-9610-48bf-8744-6e566bb372b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:41.596398 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9aeb6-9610-48bf-8744-6e566bb372b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.596750 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9aeb6-9610-48bf-8744-6e566bb372b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.597096 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9aeb6-9610-48bf-8744-6e566bb372b6 admin admin] PATH_INFO: `/v3/projects/07929210698d457c9edeed6fff9cfbc2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.598378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9aeb6-9610-48bf-8744-6e566bb372b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07929210698d457c9edeed6fff9cfbc2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:41.600816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9aeb6-9610-48bf-8744-6e566bb372b6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:41.638524 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34722f79-48a9-4194-af54-fd66dbf00c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:41.639428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722f79-48a9-4194-af54-fd66dbf00c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.639868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722f79-48a9-4194-af54-fd66dbf00c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.640103 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722f79-48a9-4194-af54-fd66dbf00c70 admin admin] PATH_INFO: `/v3/projects/0361212d89bd4222a0dd54b8172161c0/users/66447d6a788b40f68d98cc6049e1116f/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.642375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34722f79-48a9-4194-af54-fd66dbf00c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0361212d89bd4222a0dd54b8172161c0, user_id=66447d6a788b40f68d98cc6049e1116f, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:41.645202 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34722f79-48a9-4194-af54-fd66dbf00c70 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:41.655387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-cde9aeb6-9610-48bf-8744-6e566bb372b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07929210698d457c9edeed6fff9cfbc2', 'request_id': 'req-cde9aeb6-9610-48bf-8744-6e566bb372b6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.657310 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 961/1918] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:41 2022] PUT /identity/v3/projects/0361212d89bd4222a0dd54b8172161c0/users/66447d6a788b40f68d98cc6049e1116f/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:41.658591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1fdfd-8a86-4819-8d3d-f6ad4cc53ae0 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.661652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1fdfd-8a86-4819-8d3d-f6ad4cc53ae0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.661652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1fdfd-8a86-4819-8d3d-f6ad4cc53ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.668540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-cde9aeb6-9610-48bf-8744-6e566bb372b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07929210698d457c9edeed6fff9cfbc2', 'request_id': 'req-cde9aeb6-9610-48bf-8744-6e566bb372b6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.679971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-cde9aeb6-9610-48bf-8744-6e566bb372b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07929210698d457c9edeed6fff9cfbc2', 'request_id': 'req-cde9aeb6-9610-48bf-8744-6e566bb372b6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.682349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-7bf1fdfd-8a86-4819-8d3d-f6ad4cc53ae0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:41.683656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7bf1fdfd-8a86-4819-8d3d-f6ad4cc53ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:41.693686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-cde9aeb6-9610-48bf-8744-6e566bb372b6 admin admin] The token cache is being invalidate because project 07929210698d457c9edeed6fff9cfbc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:41.693975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-cde9aeb6-9610-48bf-8744-6e566bb372b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.694753 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-cde9aeb6-9610-48bf-8744-6e566bb372b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.699348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 958/1919] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:41 2022] DELETE /identity/v3/projects/07929210698d457c9edeed6fff9cfbc2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:41.699348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a097b02-d4c4-4315-b3c6-42761e30081e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.699348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a097b02-d4c4-4315-b3c6-42761e30081e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.699348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a097b02-d4c4-4315-b3c6-42761e30081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.725046 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-7a097b02-d4c4-4315-b3c6-42761e30081e None None] MFA Rules not processed for user `66447d6a788b40f68d98cc6049e1116f`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:41.727126 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-7a097b02-d4c4-4315-b3c6-42761e30081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:41.749289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 962/1920] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:41.751099 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1fdfd-8a86-4819-8d3d-f6ad4cc53ae0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:41.754251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7bf1fdfd-8a86-4819-8d3d-f6ad4cc53ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:41.767934 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1fdfd-8a86-4819-8d3d-f6ad4cc53ae0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:41.773227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:41.774092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.774404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.774690 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] PATH_INFO: `/v3/users/a5af9fce55e040cea622f5108e4da9df` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.776021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5af9fce55e040cea622f5108e4da9df)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:41.777935 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:41.815500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 959/1921] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:41.820058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3d543-0cb4-4838-b04f-c83113ad70a6 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.820348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3d543-0cb4-4838-b04f-c83113ad70a6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.820770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3d543-0cb4-4838-b04f-c83113ad70a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.830315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5af9fce55e040cea622f5108e4da9df'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.839862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e5f3d543-0cb4-4838-b04f-c83113ad70a6 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:41.840299 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5af9fce55e040cea622f5108e4da9df'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.840923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e5f3d543-0cb4-4838-b04f-c83113ad70a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:41.851011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 960/1922] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:41.854522 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3d543-0cb4-4838-b04f-c83113ad70a6 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:41.854622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5af9fce55e040cea622f5108e4da9df'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.854622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5af9fce55e040cea622f5108e4da9df'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.855528 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e5f3d543-0cb4-4838-b04f-c83113ad70a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:41.861169 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5af9fce55e040cea622f5108e4da9df'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:41.867272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3d543-0cb4-4838-b04f-c83113ad70a6 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:41.867712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 963/1923] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:41 2022] DELETE /identity/v3/users/a5af9fce55e040cea622f5108e4da9df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:41.869406 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:41.875865 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:41.948958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:41.950100 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.950564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.950981 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] PATH_INFO: `/v3/projects/92d38f701c8b43a7b032d3d2e8db2b86` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.952572 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d38f701c8b43a7b032d3d2e8db2b86)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:41.954711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:41.961343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef130e-325d-4b73-bbde-758c30ef7504 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:41.970196 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b249a9-9e8e-41bf-99b0-2f52bb2cb2e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:41.970906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b249a9-9e8e-41bf-99b0-2f52bb2cb2e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:41.971191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b249a9-9e8e-41bf-99b0-2f52bb2cb2e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:41.971468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b249a9-9e8e-41bf-99b0-2f52bb2cb2e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:41.973926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a5b249a9-9e8e-41bf-99b0-2f52bb2cb2e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.025650 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d38f701c8b43a7b032d3d2e8db2b86', 'request_id': 'req-bda1f4ef-2751-4948-9912-6685dec6f43c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.032097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d38f701c8b43a7b032d3d2e8db2b86', 'request_id': 'req-bda1f4ef-2751-4948-9912-6685dec6f43c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.041892 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d38f701c8b43a7b032d3d2e8db2b86', 'request_id': 'req-bda1f4ef-2751-4948-9912-6685dec6f43c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.055555 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] The token cache is being invalidate because project 92d38f701c8b43a7b032d3d2e8db2b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:42.056707 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.057675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.063682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 961/1924] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:41 2022] DELETE /identity/v3/projects/92d38f701c8b43a7b032d3d2e8db2b86 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:42.064560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.067296 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.083654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b249a9-9e8e-41bf-99b0-2f52bb2cb2e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.085680 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b249a9-9e8e-41bf-99b0-2f52bb2cb2e9 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.098048 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 964/1925] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:42.099336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3c30d-487b-4a85-b4d9-1b33313bcd05 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.099600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3c30d-487b-4a85-b4d9-1b33313bcd05 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.099880 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3c30d-487b-4a85-b4d9-1b33313bcd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.119649 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c0b3c30d-487b-4a85-b4d9-1b33313bcd05 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:42.120843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c0b3c30d-487b-4a85-b4d9-1b33313bcd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.167064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1f4ef-2751-4948-9912-6685dec6f43c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.173064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ac619-57f5-4a9c-aaba-833dc9e9ff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.173915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ac619-57f5-4a9c-aaba-833dc9e9ff78 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.174368 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ac619-57f5-4a9c-aaba-833dc9e9ff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.174721 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ac619-57f5-4a9c-aaba-833dc9e9ff78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.175522 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ac619-57f5-4a9c-aaba-833dc9e9ff78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:42.176247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ac619-57f5-4a9c-aaba-833dc9e9ff78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.178000 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ac619-57f5-4a9c-aaba-833dc9e9ff78 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.197234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 962/1926] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:42.197234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ac619-57f5-4a9c-aaba-833dc9e9ff78 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.197234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-355ac619-57f5-4a9c-aaba-833dc9e9ff78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.208936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 965/1927] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:42.211412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3c30d-487b-4a85-b4d9-1b33313bcd05 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.217171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ac619-57f5-4a9c-aaba-833dc9e9ff78 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.226439 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8be85-a849-45d8-8b36-661a2054b63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.227872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8be85-a849-45d8-8b36-661a2054b63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.228160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8be85-a849-45d8-8b36-661a2054b63c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.228441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8be85-a849-45d8-8b36-661a2054b63c admin admin] PATH_INFO: `/v3/users/378b4736a92149c29e756f850d53987d` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.228891 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3c30d-487b-4a85-b4d9-1b33313bcd05 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.229984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8be85-a849-45d8-8b36-661a2054b63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=378b4736a92149c29e756f850d53987d)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.233923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff75141-0f47-4965-9184-fa5a7c56ba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.234251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8be85-a849-45d8-8b36-661a2054b63c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.234838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff75141-0f47-4965-9184-fa5a7c56ba5e admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.235181 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff75141-0f47-4965-9184-fa5a7c56ba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.235528 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff75141-0f47-4965-9184-fa5a7c56ba5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.236370 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff75141-0f47-4965-9184-fa5a7c56ba5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.238580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff75141-0f47-4965-9184-fa5a7c56ba5e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.293083 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 966/1928] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:42 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:42.294085 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff75141-0f47-4965-9184-fa5a7c56ba5e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.297401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-2ff75141-0f47-4965-9184-fa5a7c56ba5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.299448 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e6e8be85-a849-45d8-8b36-661a2054b63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378b4736a92149c29e756f850d53987d'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.310133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e6e8be85-a849-45d8-8b36-661a2054b63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378b4736a92149c29e756f850d53987d'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.328543 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e6e8be85-a849-45d8-8b36-661a2054b63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378b4736a92149c29e756f850d53987d'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.330701 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e6e8be85-a849-45d8-8b36-661a2054b63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378b4736a92149c29e756f850d53987d'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.331415 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e6e8be85-a849-45d8-8b36-661a2054b63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378b4736a92149c29e756f850d53987d'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.351622 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 963/1929] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:42 2022] DELETE /identity/v3/users/378b4736a92149c29e756f850d53987d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:42.356155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe065f52-e46c-4641-a602-3a32d7c9ac1e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.356480 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe065f52-e46c-4641-a602-3a32d7c9ac1e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.356771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe065f52-e46c-4641-a602-3a32d7c9ac1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.359936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff75141-0f47-4965-9184-fa5a7c56ba5e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.382152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-fe065f52-e46c-4641-a602-3a32d7c9ac1e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:42.383405 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-fe065f52-e46c-4641-a602-3a32d7c9ac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.419461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c75d8d-21a5-4c85-bcfc-64947789a0a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.419461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c75d8d-21a5-4c85-bcfc-64947789a0a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.419461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c75d8d-21a5-4c85-bcfc-64947789a0a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.419461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c75d8d-21a5-4c85-bcfc-64947789a0a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.419854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-51c75d8d-21a5-4c85-bcfc-64947789a0a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.454306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 964/1930] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:42.454306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe065f52-e46c-4641-a602-3a32d7c9ac1e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.455538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-fe065f52-e46c-4641-a602-3a32d7c9ac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.467391 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe065f52-e46c-4641-a602-3a32d7c9ac1e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.472118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.472952 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.473293 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.473558 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] PATH_INFO: `/v3/projects/1475ec90bf394e5f8aa66c77676684d1` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.474839 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1475ec90bf394e5f8aa66c77676684d1)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.476704 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.479244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c75d8d-21a5-4c85-bcfc-64947789a0a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.480679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c75d8d-21a5-4c85-bcfc-64947789a0a9 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.489396 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 967/1931] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:42.490250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c75d8d-21a5-4c85-bcfc-64947789a0a9 service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.491715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-51c75d8d-21a5-4c85-bcfc-64947789a0a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.505367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c75d8d-21a5-4c85-bcfc-64947789a0a9 service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.511459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6bfb3-aca1-4a2a-921b-99924d74d423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.512201 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6bfb3-aca1-4a2a-921b-99924d74d423 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.512491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6bfb3-aca1-4a2a-921b-99924d74d423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.512768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6bfb3-aca1-4a2a-921b-99924d74d423 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.513540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6bfb3-aca1-4a2a-921b-99924d74d423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.515598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6bfb3-aca1-4a2a-921b-99924d74d423 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.527568 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1475ec90bf394e5f8aa66c77676684d1', 'request_id': 'req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.534415 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1475ec90bf394e5f8aa66c77676684d1', 'request_id': 'req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.538171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 968/1932] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:42 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:42.539366 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef368a-26fe-483e-8a9b-f398efbe214e None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.539689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef368a-26fe-483e-8a9b-f398efbe214e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.539963 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef368a-26fe-483e-8a9b-f398efbe214e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.543556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1475ec90bf394e5f8aa66c77676684d1', 'request_id': 'req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.555500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] The token cache is being invalidate because project 1475ec90bf394e5f8aa66c77676684d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:42.555787 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.556570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:42.557795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b9ef368a-26fe-483e-8a9b-f398efbe214e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:42.558248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 965/1933] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:42 2022] DELETE /identity/v3/projects/1475ec90bf394e5f8aa66c77676684d1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:42.562040 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b9ef368a-26fe-483e-8a9b-f398efbe214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.562308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.562308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.626072 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc4d02-6408-4dfe-b2d0-2f88aff8b06f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.627397 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 969/1934] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:42.628307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef368a-26fe-483e-8a9b-f398efbe214e None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.630522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b9ef368a-26fe-483e-8a9b-f398efbe214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.635116 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c45e9-6958-45e5-8bbd-4898ba4428c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.635787 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c45e9-6958-45e5-8bbd-4898ba4428c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.636067 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c45e9-6958-45e5-8bbd-4898ba4428c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.636384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c45e9-6958-45e5-8bbd-4898ba4428c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.637117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c45e9-6958-45e5-8bbd-4898ba4428c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:42.637474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c45e9-6958-45e5-8bbd-4898ba4428c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.639248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c45e9-6958-45e5-8bbd-4898ba4428c2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.646315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef368a-26fe-483e-8a9b-f398efbe214e None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.653030 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 966/1935] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:42.654471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5f7d8-82a2-40cd-ada6-dec1475488df None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.654771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5f7d8-82a2-40cd-ada6-dec1475488df None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.655035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5f7d8-82a2-40cd-ada6-dec1475488df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.657862 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622d7dd-4b1f-45d3-bc7e-e8b0975994d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.659065 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622d7dd-4b1f-45d3-bc7e-e8b0975994d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.659726 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622d7dd-4b1f-45d3-bc7e-e8b0975994d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.660177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622d7dd-4b1f-45d3-bc7e-e8b0975994d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.661107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622d7dd-4b1f-45d3-bc7e-e8b0975994d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.662983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622d7dd-4b1f-45d3-bc7e-e8b0975994d6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.673463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-68a5f7d8-82a2-40cd-ada6-dec1475488df None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:42.674958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-68a5f7d8-82a2-40cd-ada6-dec1475488df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.676265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 970/1936] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:42.680379 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622d7dd-4b1f-45d3-bc7e-e8b0975994d6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.682040 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7622d7dd-4b1f-45d3-bc7e-e8b0975994d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.689232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 967/1937] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:42.689232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5f7d8-82a2-40cd-ada6-dec1475488df None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.700977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5f7d8-82a2-40cd-ada6-dec1475488df None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.705784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd65c3-4f01-41fa-b405-486b57f99e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.706638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd65c3-4f01-41fa-b405-486b57f99e8e admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.706924 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd65c3-4f01-41fa-b405-486b57f99e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.707193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd65c3-4f01-41fa-b405-486b57f99e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.707998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd65c3-4f01-41fa-b405-486b57f99e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.710489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd65c3-4f01-41fa-b405-486b57f99e8e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.738334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 968/1938] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:42 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:42.742672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd65c3-4f01-41fa-b405-486b57f99e8e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.750385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622d7dd-4b1f-45d3-bc7e-e8b0975994d6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.817928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd65c3-4f01-41fa-b405-486b57f99e8e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.822461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7bcd9-5148-4749-b3b5-020f2ed65996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.823309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7bcd9-5148-4749-b3b5-020f2ed65996 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.823601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7bcd9-5148-4749-b3b5-020f2ed65996 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.823871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7bcd9-5148-4749-b3b5-020f2ed65996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.824806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9b2ab-0c2a-4c19-bdd0-4acdae41218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.825673 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9b2ab-0c2a-4c19-bdd0-4acdae41218c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.825919 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9b2ab-0c2a-4c19-bdd0-4acdae41218c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.826198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9b2ab-0c2a-4c19-bdd0-4acdae41218c admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.826972 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9b2ab-0c2a-4c19-bdd0-4acdae41218c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.828612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9b2ab-0c2a-4c19-bdd0-4acdae41218c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.834489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7bcd9-5148-4749-b3b5-020f2ed65996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.836826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7bcd9-5148-4749-b3b5-020f2ed65996 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.840516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 969/1939] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:42.842025 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d5acd-93ad-435f-97ac-0d2d890d077a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.842359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d5acd-93ad-435f-97ac-0d2d890d077a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.842640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d5acd-93ad-435f-97ac-0d2d890d077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.849053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 971/1940] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:42.849922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7bcd9-5148-4749-b3b5-020f2ed65996 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.861880 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7bcd9-5148-4749-b3b5-020f2ed65996 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.867361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8972d78-2a48-4419-b702-7041bd34ae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.868095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8972d78-2a48-4419-b702-7041bd34ae9c admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.868551 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8972d78-2a48-4419-b702-7041bd34ae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.868803 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-490d5acd-93ad-435f-97ac-0d2d890d077a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:42.868925 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8972d78-2a48-4419-b702-7041bd34ae9c admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.869488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8972d78-2a48-4419-b702-7041bd34ae9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.870376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-490d5acd-93ad-435f-97ac-0d2d890d077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:42.871426 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8972d78-2a48-4419-b702-7041bd34ae9c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.879509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 970/1941] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:42.882196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d5acd-93ad-435f-97ac-0d2d890d077a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.892339 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d5acd-93ad-435f-97ac-0d2d890d077a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.895679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 972/1942] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:42 2022] POST /identity/v3/users => generated 284 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:42.895679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8972d78-2a48-4419-b702-7041bd34ae9c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.901635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fd75a-50fc-441f-9ae5-d6e734c8cb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.903049 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fd75a-50fc-441f-9ae5-d6e734c8cb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.903331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fd75a-50fc-441f-9ae5-d6e734c8cb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.903601 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fd75a-50fc-441f-9ae5-d6e734c8cb8d admin admin] PATH_INFO: `/v3/projects/f959c2e7ebf44e5e819d620da2f346d3/users/56babdbf5088443585cf9841b1f49350/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.904819 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8972d78-2a48-4419-b702-7041bd34ae9c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:42.911441 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683b34f-4bb1-4843-920f-eba9c4349e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:42.912666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683b34f-4bb1-4843-920f-eba9c4349e49 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:42.913692 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683b34f-4bb1-4843-920f-eba9c4349e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:42.913980 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683b34f-4bb1-4843-920f-eba9c4349e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:42.914926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683b34f-4bb1-4843-920f-eba9c4349e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:42.917608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683b34f-4bb1-4843-920f-eba9c4349e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.917867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683b34f-4bb1-4843-920f-eba9c4349e49 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.920285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fd75a-50fc-441f-9ae5-d6e734c8cb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f959c2e7ebf44e5e819d620da2f346d3, user_id=56babdbf5088443585cf9841b1f49350, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:42.923043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fd75a-50fc-441f-9ae5-d6e734c8cb8d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:42.936057 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 973/1943] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:42.936872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 971/1944] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:42 2022] PUT /identity/v3/projects/f959c2e7ebf44e5e819d620da2f346d3/users/56babdbf5088443585cf9841b1f49350/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:42.937250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683b34f-4bb1-4843-920f-eba9c4349e49 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.940577 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fd75a-50fc-441f-9ae5-d6e734c8cb8d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:42.951472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683b34f-4bb1-4843-920f-eba9c4349e49 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.026512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b89daa-4420-484d-939d-9885adc5a9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.027341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b89daa-4420-484d-939d-9885adc5a9cb admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.027692 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b89daa-4420-484d-939d-9885adc5a9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.028011 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b89daa-4420-484d-939d-9885adc5a9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.028630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b89daa-4420-484d-939d-9885adc5a9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.030406 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b89daa-4420-484d-939d-9885adc5a9cb admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.032422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fd75a-50fc-441f-9ae5-d6e734c8cb8d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.040584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37b1ca-84a9-4e06-b5bb-afba7bc88962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.041263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b1ca-84a9-4e06-b5bb-afba7bc88962 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.041589 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b1ca-84a9-4e06-b5bb-afba7bc88962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.041863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b1ca-84a9-4e06-b5bb-afba7bc88962 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.042597 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37b1ca-84a9-4e06-b5bb-afba7bc88962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.043350 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 974/1945] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:43.044610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f870d-ee28-4540-93c7-4d13e7325f00 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.044903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f870d-ee28-4540-93c7-4d13e7325f00 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.045180 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f870d-ee28-4540-93c7-4d13e7325f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.049108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37b1ca-84a9-4e06-b5bb-afba7bc88962 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.079543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-6d4f870d-ee28-4540-93c7-4d13e7325f00 None None] MFA Rules not processed for user `56babdbf5088443585cf9841b1f49350`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:43.080698 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6d4f870d-ee28-4540-93c7-4d13e7325f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:43.097829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 972/1946] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:42 2022] POST /identity/v3/projects => generated 357 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:38:43.098933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37b1ca-84a9-4e06-b5bb-afba7bc88962 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.196309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 975/1947] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:43.197230 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f870d-ee28-4540-93c7-4d13e7325f00 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.201457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37b1ca-84a9-4e06-b5bb-afba7bc88962 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.213109 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f870d-ee28-4540-93c7-4d13e7325f00 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.218067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f347e-9372-457a-920f-7af15b378c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.218810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f347e-9372-457a-920f-7af15b378c00 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.219214 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f347e-9372-457a-920f-7af15b378c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.219502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f347e-9372-457a-920f-7af15b378c00 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.220243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f347e-9372-457a-920f-7af15b378c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.222127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f347e-9372-457a-920f-7af15b378c00 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.226431 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbff5f2-019e-4eb5-9e51-dd0db7dbd010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.227124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbff5f2-019e-4eb5-9e51-dd0db7dbd010 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.227408 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbff5f2-019e-4eb5-9e51-dd0db7dbd010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.227727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbff5f2-019e-4eb5-9e51-dd0db7dbd010 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.228426 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbff5f2-019e-4eb5-9e51-dd0db7dbd010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.231124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbff5f2-019e-4eb5-9e51-dd0db7dbd010 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.249878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 976/1948] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:43 2022] POST /identity/v3/users => generated 279 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:43.249878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f347e-9372-457a-920f-7af15b378c00 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.250122 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 973/1949] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:43.251058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbff5f2-019e-4eb5-9e51-dd0db7dbd010 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.254042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-dfbff5f2-019e-4eb5-9e51-dd0db7dbd010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:43.264254 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f347e-9372-457a-920f-7af15b378c00 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.268706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbff5f2-019e-4eb5-9e51-dd0db7dbd010 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.270153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a1b94-0739-4d53-93eb-bf7c3ffbc3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.270851 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1b94-0739-4d53-93eb-bf7c3ffbc3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.271293 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1b94-0739-4d53-93eb-bf7c3ffbc3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.271610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1b94-0739-4d53-93eb-bf7c3ffbc3c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.272901 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a1b94-0739-4d53-93eb-bf7c3ffbc3c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.274446 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.274860 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a1b94-0739-4d53-93eb-bf7c3ffbc3c2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.275467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.275815 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.276093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] PATH_INFO: `/v3/projects/63648c8ea63247f193e2960e919fa19e` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.277269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63648c8ea63247f193e2960e919fa19e)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.279477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.316732 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 977/1950] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:43 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:43.321649 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bc756-f383-4bc6-8e26-65737e9021b8 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.322408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bc756-f383-4bc6-8e26-65737e9021b8 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.322408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bc756-f383-4bc6-8e26-65737e9021b8 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.328178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 978/1951] 10.222.0.79 () {54 vars in 921 bytes} [Mon Feb 21 01:38:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:38:43.331818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bc756-f383-4bc6-8e26-65737e9021b8 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.350919 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63648c8ea63247f193e2960e919fa19e', 'request_id': 'req-357dd1f9-d8c3-4fb6-9644-55017b48a460'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:43.367154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63648c8ea63247f193e2960e919fa19e', 'request_id': 'req-357dd1f9-d8c3-4fb6-9644-55017b48a460'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:43.377779 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63648c8ea63247f193e2960e919fa19e', 'request_id': 'req-357dd1f9-d8c3-4fb6-9644-55017b48a460'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:43.395489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] The token cache is being invalidate because project 63648c8ea63247f193e2960e919fa19e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:43.398516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:43.407717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:43.407717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 974/1952] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:43 2022] DELETE /identity/v3/projects/63648c8ea63247f193e2960e919fa19e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:43.407717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.410064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:43.420999 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bc756-f383-4bc6-8e26-65737e9021b8 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.422674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dd1f9-d8c3-4fb6-9644-55017b48a460 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.427587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ccdf0-140f-4987-8892-2857f7a53807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.428652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ccdf0-140f-4987-8892-2857f7a53807 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.428931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ccdf0-140f-4987-8892-2857f7a53807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.429207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ccdf0-140f-4987-8892-2857f7a53807 admin admin] PATH_INFO: `/v3/projects/d194dcea674143fb9a5f70532b8ed15f/users/cc619157a38d469ba44b78345cb5cff3/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.439341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a20c39-e51d-4516-8167-24e3e5c42f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.439957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a20c39-e51d-4516-8167-24e3e5c42f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.440299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a20c39-e51d-4516-8167-24e3e5c42f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.440700 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a20c39-e51d-4516-8167-24e3e5c42f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.441371 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a20c39-e51d-4516-8167-24e3e5c42f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.443692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a20c39-e51d-4516-8167-24e3e5c42f73 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.451303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ccdf0-140f-4987-8892-2857f7a53807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d194dcea674143fb9a5f70532b8ed15f, user_id=cc619157a38d469ba44b78345cb5cff3, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.454352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ccdf0-140f-4987-8892-2857f7a53807 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.462698 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 975/1953] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:43.467135 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a20c39-e51d-4516-8167-24e3e5c42f73 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.469579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-21a20c39-e51d-4516-8167-24e3e5c42f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:43.472667 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 979/1954] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:43 2022] PUT /identity/v3/projects/d194dcea674143fb9a5f70532b8ed15f/users/cc619157a38d469ba44b78345cb5cff3/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:43.474159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb356c-ba00-4b84-a5e7-84168caa0ce2 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.474721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb356c-ba00-4b84-a5e7-84168caa0ce2 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.475004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb356c-ba00-4b84-a5e7-84168caa0ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.497103 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a20c39-e51d-4516-8167-24e3e5c42f73 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.500278 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-ebdb356c-ba00-4b84-a5e7-84168caa0ce2 None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:43.501475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ebdb356c-ba00-4b84-a5e7-84168caa0ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:43.600043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 980/1955] 10.222.0.79 () {58 vars in 1018 bytes} [Mon Feb 21 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:43.602327 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c52f0-df0b-4044-88d3-db8da1fa1938 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.602722 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c52f0-df0b-4044-88d3-db8da1fa1938 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.603108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c52f0-df0b-4044-88d3-db8da1fa1938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.614529 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af91a89-a496-4a84-842e-5bad9ee8366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.615217 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91a89-a496-4a84-842e-5bad9ee8366d admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.615504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91a89-a496-4a84-842e-5bad9ee8366d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.615783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91a89-a496-4a84-842e-5bad9ee8366d admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.617024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af91a89-a496-4a84-842e-5bad9ee8366d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.619243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af91a89-a496-4a84-842e-5bad9ee8366d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.624510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-435c52f0-df0b-4044-88d3-db8da1fa1938 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:43.625952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-435c52f0-df0b-4044-88d3-db8da1fa1938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:43.641916 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 981/1956] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:43.641916 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c52f0-df0b-4044-88d3-db8da1fa1938 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.649031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c52f0-df0b-4044-88d3-db8da1fa1938 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.656673 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 976/1957] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:43 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:43.658423 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc361e18-8c55-4246-ab13-c4b06ce40a09 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.658778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc361e18-8c55-4246-ab13-c4b06ce40a09 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.659098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc361e18-8c55-4246-ab13-c4b06ce40a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.659502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d371b-62ed-4fdb-9b0b-94b613fe077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.660228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d371b-62ed-4fdb-9b0b-94b613fe077d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.663422 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d371b-62ed-4fdb-9b0b-94b613fe077d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.663837 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d371b-62ed-4fdb-9b0b-94b613fe077d admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.664591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d371b-62ed-4fdb-9b0b-94b613fe077d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.668491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d371b-62ed-4fdb-9b0b-94b613fe077d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.688570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 982/1958] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:43.688570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb888435-8039-4824-b83d-fc5dabdd965b None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.688570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb888435-8039-4824-b83d-fc5dabdd965b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.688570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb888435-8039-4824-b83d-fc5dabdd965b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.693753 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-fc361e18-8c55-4246-ab13-c4b06ce40a09 None None] MFA Rules not processed for user `cc619157a38d469ba44b78345cb5cff3`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:43.695983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-fc361e18-8c55-4246-ab13-c4b06ce40a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:43.711985 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-bb888435-8039-4824-b83d-fc5dabdd965b None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:43.714856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-bb888435-8039-4824-b83d-fc5dabdd965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:43.723569 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 983/1959] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:43.724700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb888435-8039-4824-b83d-fc5dabdd965b None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.741353 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb888435-8039-4824-b83d-fc5dabdd965b None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.746750 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5eb86-8d25-4e6c-b2d6-da17ee61c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.747557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5eb86-8d25-4e6c-b2d6-da17ee61c323 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.747930 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5eb86-8d25-4e6c-b2d6-da17ee61c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.748280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5eb86-8d25-4e6c-b2d6-da17ee61c323 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.749091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5eb86-8d25-4e6c-b2d6-da17ee61c323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.750811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5eb86-8d25-4e6c-b2d6-da17ee61c323 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.762094 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 984/1960] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:43.765572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5eb86-8d25-4e6c-b2d6-da17ee61c323 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.765572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-2ef5eb86-8d25-4e6c-b2d6-da17ee61c323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:43.771934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 977/1961] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:43.773117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc361e18-8c55-4246-ab13-c4b06ce40a09 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.783185 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5eb86-8d25-4e6c-b2d6-da17ee61c323 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.786535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc361e18-8c55-4246-ab13-c4b06ce40a09 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.789455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1e09b-aa05-406e-a6e2-7c41ccac59d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.790119 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1e09b-aa05-406e-a6e2-7c41ccac59d8 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.790435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1e09b-aa05-406e-a6e2-7c41ccac59d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.790708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1e09b-aa05-406e-a6e2-7c41ccac59d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.791486 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed7eff-1230-4f46-82df-f4207c7b6183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.792456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed7eff-1230-4f46-82df-f4207c7b6183 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.792836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed7eff-1230-4f46-82df-f4207c7b6183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.793185 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed7eff-1230-4f46-82df-f4207c7b6183 admin admin] PATH_INFO: `/v3/projects/ebd02c1041aa48818a09e37eeb85f508/users/3015f33252614138b3ed72bf0e6ed067/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.800457 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1e09b-aa05-406e-a6e2-7c41ccac59d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.802066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1e09b-aa05-406e-a6e2-7c41ccac59d8 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.809860 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed7eff-1230-4f46-82df-f4207c7b6183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd02c1041aa48818a09e37eeb85f508, user_id=3015f33252614138b3ed72bf0e6ed067, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.812910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed7eff-1230-4f46-82df-f4207c7b6183 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.814168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 985/1962] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:43.815090 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1e09b-aa05-406e-a6e2-7c41ccac59d8 service nova] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.827512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1e09b-aa05-406e-a6e2-7c41ccac59d8 service nova] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.832809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 978/1963] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:43 2022] PUT /identity/v3/projects/ebd02c1041aa48818a09e37eeb85f508/users/3015f33252614138b3ed72bf0e6ed067/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:43.833828 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed7eff-1230-4f46-82df-f4207c7b6183 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.920229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed7eff-1230-4f46-82df-f4207c7b6183 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.926259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18d7cc-6f61-4573-be6d-ba11417ae3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.927263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18d7cc-6f61-4573-be6d-ba11417ae3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.927619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18d7cc-6f61-4573-be6d-ba11417ae3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.927719 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8160682-b128-4f94-925e-f9091891d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:43.928188 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18d7cc-6f61-4573-be6d-ba11417ae3d8 admin admin] PATH_INFO: `/v3/projects/cbff087944bc4797acc12b49cfdc4b52/users/a9748b933886492e957a600a8d11f4ea/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.929577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8160682-b128-4f94-925e-f9091891d5fa admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.938893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8160682-b128-4f94-925e-f9091891d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.946767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8160682-b128-4f94-925e-f9091891d5fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:43.947586 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8160682-b128-4f94-925e-f9091891d5fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:43.947905 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8160682-b128-4f94-925e-f9091891d5fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.949527 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8160682-b128-4f94-925e-f9091891d5fa admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.952177 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18d7cc-6f61-4573-be6d-ba11417ae3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbff087944bc4797acc12b49cfdc4b52, user_id=a9748b933886492e957a600a8d11f4ea, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:43.954914 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18d7cc-6f61-4573-be6d-ba11417ae3d8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:43.973537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 986/1964] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:43.973537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8160682-b128-4f94-925e-f9091891d5fa admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:43.973537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b8160682-b128-4f94-925e-f9091891d5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:43.986844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8160682-b128-4f94-925e-f9091891d5fa admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:43.993888 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 979/1965] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:43 2022] PUT /identity/v3/projects/cbff087944bc4797acc12b49cfdc4b52/users/a9748b933886492e957a600a8d11f4ea/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:43.995834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282d5ff-b2a4-426b-9043-46e166ec482a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:43.996868 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282d5ff-b2a4-426b-9043-46e166ec482a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:43.999316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282d5ff-b2a4-426b-9043-46e166ec482a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.058682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-1282d5ff-b2a4-426b-9043-46e166ec482a None None] MFA Rules not processed for user `3015f33252614138b3ed72bf0e6ed067`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:44.061598 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-1282d5ff-b2a4-426b-9043-46e166ec482a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:44.100952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e8f52-a27a-42a4-be7c-338e21ce0da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.101771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e8f52-a27a-42a4-be7c-338e21ce0da0 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.102054 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e8f52-a27a-42a4-be7c-338e21ce0da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.102476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e8f52-a27a-42a4-be7c-338e21ce0da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.103315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e8f52-a27a-42a4-be7c-338e21ce0da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.105097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e8f52-a27a-42a4-be7c-338e21ce0da0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.150802 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 980/1966] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:44.151625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282d5ff-b2a4-426b-9043-46e166ec482a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.158287 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 987/1967] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:43 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:44.158287 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e8f52-a27a-42a4-be7c-338e21ce0da0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.163714 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282d5ff-b2a4-426b-9043-46e166ec482a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.240238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e8f52-a27a-42a4-be7c-338e21ce0da0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.247524 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f1321-320b-48a8-9341-310b475b5380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.248481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f1321-320b-48a8-9341-310b475b5380 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.248851 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f1321-320b-48a8-9341-310b475b5380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.249278 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f1321-320b-48a8-9341-310b475b5380 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.250155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f1321-320b-48a8-9341-310b475b5380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.252290 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f1321-320b-48a8-9341-310b475b5380 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.268693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 988/1968] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:44.268693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f1321-320b-48a8-9341-310b475b5380 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.273258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5425d75-d877-4385-8613-f8d6716dbe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.274144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5425d75-d877-4385-8613-f8d6716dbe18 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.274700 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5425d75-d877-4385-8613-f8d6716dbe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.274983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5425d75-d877-4385-8613-f8d6716dbe18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.275737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5425d75-d877-4385-8613-f8d6716dbe18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.277764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5425d75-d877-4385-8613-f8d6716dbe18 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.296855 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f1321-320b-48a8-9341-310b475b5380 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.309806 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c599f-a0bb-45f9-9706-67bd40432755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.310752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c599f-a0bb-45f9-9706-67bd40432755 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.311156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c599f-a0bb-45f9-9706-67bd40432755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.311452 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c599f-a0bb-45f9-9706-67bd40432755 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.312508 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c599f-a0bb-45f9-9706-67bd40432755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.315947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c599f-a0bb-45f9-9706-67bd40432755 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.333543 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 981/1969] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:44 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:44.335993 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5425d75-d877-4385-8613-f8d6716dbe18 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.364590 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 989/1970] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:44 2022] POST /identity/v3/projects => generated 357 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:44.365483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c599f-a0bb-45f9-9706-67bd40432755 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.416552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5425d75-d877-4385-8613-f8d6716dbe18 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.448155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c599f-a0bb-45f9-9706-67bd40432755 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.454596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f39b10-323d-49ab-8179-7b4bec5163c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.455872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f39b10-323d-49ab-8179-7b4bec5163c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.456148 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f39b10-323d-49ab-8179-7b4bec5163c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.456429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f39b10-323d-49ab-8179-7b4bec5163c1 admin admin] PATH_INFO: `/v3/projects/cbff087944bc4797acc12b49cfdc4b52/users/a9748b933886492e957a600a8d11f4ea/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.458481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f39b10-323d-49ab-8179-7b4bec5163c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbff087944bc4797acc12b49cfdc4b52, user_id=a9748b933886492e957a600a8d11f4ea, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.461394 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f39b10-323d-49ab-8179-7b4bec5163c1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.477399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae3896-3d2d-4c1a-833e-15ae7ec24252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.478091 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae3896-3d2d-4c1a-833e-15ae7ec24252 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.478409 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae3896-3d2d-4c1a-833e-15ae7ec24252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.487248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae3896-3d2d-4c1a-833e-15ae7ec24252 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.487450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 990/1971] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:44 2022] PUT /identity/v3/projects/cbff087944bc4797acc12b49cfdc4b52/users/a9748b933886492e957a600a8d11f4ea/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:44.487535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae3896-3d2d-4c1a-833e-15ae7ec24252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.487605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f39b10-323d-49ab-8179-7b4bec5163c1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.487671 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae3896-3d2d-4c1a-833e-15ae7ec24252 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.507519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 982/1972] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:44 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:44.508901 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae3896-3d2d-4c1a-833e-15ae7ec24252 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.519492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae3896-3d2d-4c1a-833e-15ae7ec24252 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.545626 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f39b10-323d-49ab-8179-7b4bec5163c1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.552047 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e34d21-6b08-413f-9af4-0cef615de37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.552810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e34d21-6b08-413f-9af4-0cef615de37e admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.553105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e34d21-6b08-413f-9af4-0cef615de37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.554333 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e34d21-6b08-413f-9af4-0cef615de37e admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.555085 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e34d21-6b08-413f-9af4-0cef615de37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.557237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e34d21-6b08-413f-9af4-0cef615de37e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.581485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d3a18-51a1-408c-ac5f-4fdbc3459246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.582276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d3a18-51a1-408c-ac5f-4fdbc3459246 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.582629 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d3a18-51a1-408c-ac5f-4fdbc3459246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.582910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d3a18-51a1-408c-ac5f-4fdbc3459246 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.583612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d3a18-51a1-408c-ac5f-4fdbc3459246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.584191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 991/1973] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:44 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:44.585638 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3afd80-0e0c-41f9-bdd3-71a68a81fbb0 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.585757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d3a18-51a1-408c-ac5f-4fdbc3459246 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.585919 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3afd80-0e0c-41f9-bdd3-71a68a81fbb0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.586196 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3afd80-0e0c-41f9-bdd3-71a68a81fbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.609769 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 983/1974] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:44 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:44.609769 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d3a18-51a1-408c-ac5f-4fdbc3459246 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.614941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-7c3afd80-0e0c-41f9-bdd3-71a68a81fbb0 None None] MFA Rules not processed for user `a9748b933886492e957a600a8d11f4ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:44.616658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7c3afd80-0e0c-41f9-bdd3-71a68a81fbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:44.617515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d3a18-51a1-408c-ac5f-4fdbc3459246 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.622413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04ae6b-7a88-46b6-8a9c-da67e0041a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.623058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04ae6b-7a88-46b6-8a9c-da67e0041a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.623341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04ae6b-7a88-46b6-8a9c-da67e0041a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.623615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04ae6b-7a88-46b6-8a9c-da67e0041a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.624343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04ae6b-7a88-46b6-8a9c-da67e0041a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.625918 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04ae6b-7a88-46b6-8a9c-da67e0041a6e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.639169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 984/1975] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:44.639169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04ae6b-7a88-46b6-8a9c-da67e0041a6e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.646985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04ae6b-7a88-46b6-8a9c-da67e0041a6e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.652423 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6668dee-ffe0-46bc-9af1-6b745c0d929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.653159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6668dee-ffe0-46bc-9af1-6b745c0d929e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.653502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6668dee-ffe0-46bc-9af1-6b745c0d929e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.653784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6668dee-ffe0-46bc-9af1-6b745c0d929e admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.654621 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6668dee-ffe0-46bc-9af1-6b745c0d929e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.656204 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6668dee-ffe0-46bc-9af1-6b745c0d929e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.667042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 985/1976] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:44.667834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6668dee-ffe0-46bc-9af1-6b745c0d929e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.679790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6668dee-ffe0-46bc-9af1-6b745c0d929e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.684836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f342b1e-ff55-425d-b729-fc52eb8b0440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.685496 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f342b1e-ff55-425d-b729-fc52eb8b0440 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.685775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f342b1e-ff55-425d-b729-fc52eb8b0440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.686048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f342b1e-ff55-425d-b729-fc52eb8b0440 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.686799 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f342b1e-ff55-425d-b729-fc52eb8b0440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.688378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f342b1e-ff55-425d-b729-fc52eb8b0440 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.691657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 992/1977] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:44.692400 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3afd80-0e0c-41f9-bdd3-71a68a81fbb0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.705290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 986/1978] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:44.705290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f342b1e-ff55-425d-b729-fc52eb8b0440 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.708317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3afd80-0e0c-41f9-bdd3-71a68a81fbb0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.712749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f342b1e-ff55-425d-b729-fc52eb8b0440 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.713698 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb909f1-3b56-49e8-ad80-ca35833034ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.715759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb909f1-3b56-49e8-ad80-ca35833034ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.715759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb909f1-3b56-49e8-ad80-ca35833034ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.715759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb909f1-3b56-49e8-ad80-ca35833034ab admin admin] PATH_INFO: `/v3/projects/12635f9ac4cf4650be677998deedc410/users/1efee9da856e44fe89041d50a42c778b/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.717684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad5609-66e1-4f4b-928a-d5dff0f5af11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.718382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad5609-66e1-4f4b-928a-d5dff0f5af11 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.718661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad5609-66e1-4f4b-928a-d5dff0f5af11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.718931 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad5609-66e1-4f4b-928a-d5dff0f5af11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.719654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad5609-66e1-4f4b-928a-d5dff0f5af11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.721267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad5609-66e1-4f4b-928a-d5dff0f5af11 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.733863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 987/1979] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:44.734729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad5609-66e1-4f4b-928a-d5dff0f5af11 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.736922 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-dfad5609-66e1-4f4b-928a-d5dff0f5af11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:44.739321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb909f1-3b56-49e8-ad80-ca35833034ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=12635f9ac4cf4650be677998deedc410, user_id=1efee9da856e44fe89041d50a42c778b, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.742821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb909f1-3b56-49e8-ad80-ca35833034ab admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.765453 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 993/1980] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:44 2022] PUT /identity/v3/projects/12635f9ac4cf4650be677998deedc410/users/1efee9da856e44fe89041d50a42c778b/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:44.767001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb909f1-3b56-49e8-ad80-ca35833034ab admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.823443 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad5609-66e1-4f4b-928a-d5dff0f5af11 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.834717 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb909f1-3b56-49e8-ad80-ca35833034ab admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.839667 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7040295-b538-4906-b54b-22475a449156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.840685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7040295-b538-4906-b54b-22475a449156 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.840976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7040295-b538-4906-b54b-22475a449156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.841251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7040295-b538-4906-b54b-22475a449156 admin admin] PATH_INFO: `/v3/projects/a56cfa2c3f32411895840c42c69747c0/users/279abc10212a4da1ae7169726a484278/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.876178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7040295-b538-4906-b54b-22475a449156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56cfa2c3f32411895840c42c69747c0, user_id=279abc10212a4da1ae7169726a484278, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.880270 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7040295-b538-4906-b54b-22475a449156 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.886139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927333a-765d-45ce-9c79-e106ce118cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.886826 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927333a-765d-45ce-9c79-e106ce118cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.887114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927333a-765d-45ce-9c79-e106ce118cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.887393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927333a-765d-45ce-9c79-e106ce118cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.889413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e927333a-765d-45ce-9c79-e106ce118cf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:44.897300 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 994/1981] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:44 2022] PUT /identity/v3/projects/a56cfa2c3f32411895840c42c69747c0/users/279abc10212a4da1ae7169726a484278/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:44.898489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7040295-b538-4906-b54b-22475a449156 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.947916 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927333a-765d-45ce-9c79-e106ce118cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.949401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927333a-765d-45ce-9c79-e106ce118cf5 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.958327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 988/1982] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:44.959586 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7040295-b538-4906-b54b-22475a449156 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.963429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927333a-765d-45ce-9c79-e106ce118cf5 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:44.964782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b4c45-ae15-4d62-8dcb-edb784743701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.965721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4c45-ae15-4d62-8dcb-edb784743701 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.966012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4c45-ae15-4d62-8dcb-edb784743701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.966367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4c45-ae15-4d62-8dcb-edb784743701 admin admin] PATH_INFO: `/v3/projects/3f4a571f17fa4430ba044ac2106e41b1/users/2675a53d6286472895674a3be54131b7/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.974060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927333a-765d-45ce-9c79-e106ce118cf5 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:44.979526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471373e0-f182-4ce7-8401-c06da0be85c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:44.980178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471373e0-f182-4ce7-8401-c06da0be85c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:44.980462 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471373e0-f182-4ce7-8401-c06da0be85c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:44.980736 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471373e0-f182-4ce7-8401-c06da0be85c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:44.981445 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471373e0-f182-4ce7-8401-c06da0be85c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.982016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b4c45-ae15-4d62-8dcb-edb784743701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4a571f17fa4430ba044ac2106e41b1, user_id=2675a53d6286472895674a3be54131b7, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:44.983060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471373e0-f182-4ce7-8401-c06da0be85c0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.984708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b4c45-ae15-4d62-8dcb-edb784743701 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:44.995476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 989/1983] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:44.996327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471373e0-f182-4ce7-8401-c06da0be85c0 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:45.004335 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 995/1984] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:44 2022] PUT /identity/v3/projects/3f4a571f17fa4430ba044ac2106e41b1/users/2675a53d6286472895674a3be54131b7/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:45.005144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b4c45-ae15-4d62-8dcb-edb784743701 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:45.009484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471373e0-f182-4ce7-8401-c06da0be85c0 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:45.068538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a3970-1273-4042-8367-d3f1e78afa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:45.069442 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a3970-1273-4042-8367-d3f1e78afa51 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:45.070173 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a3970-1273-4042-8367-d3f1e78afa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:45.070173 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a3970-1273-4042-8367-d3f1e78afa51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:45.070748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a3970-1273-4042-8367-d3f1e78afa51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:45.072330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a3970-1273-4042-8367-d3f1e78afa51 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:45.073864 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b4c45-ae15-4d62-8dcb-edb784743701 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:45.078754 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f8a68-3004-44d5-a1b5-437f67ef0d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:45.079780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f8a68-3004-44d5-a1b5-437f67ef0d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:45.080078 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f8a68-3004-44d5-a1b5-437f67ef0d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:45.080476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f8a68-3004-44d5-a1b5-437f67ef0d77 admin admin] PATH_INFO: `/v3/projects/12635f9ac4cf4650be677998deedc410/users/1efee9da856e44fe89041d50a42c778b/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:45.082718 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 990/1985] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:45.083033 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f8a68-3004-44d5-a1b5-437f67ef0d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12635f9ac4cf4650be677998deedc410, user_id=1efee9da856e44fe89041d50a42c778b, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:45.083823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0721c2-65db-4520-8b86-0dc6999cb722 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:45.084112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0721c2-65db-4520-8b86-0dc6999cb722 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:45.084391 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0721c2-65db-4520-8b86-0dc6999cb722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:45.086549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f8a68-3004-44d5-a1b5-437f67ef0d77 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:45.103469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 996/1986] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:45 2022] PUT /identity/v3/projects/12635f9ac4cf4650be677998deedc410/users/1efee9da856e44fe89041d50a42c778b/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:45.111425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f8a68-3004-44d5-a1b5-437f67ef0d77 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:45.111782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0b0721c2-65db-4520-8b86-0dc6999cb722 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:45.113171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0b0721c2-65db-4520-8b86-0dc6999cb722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:45.179678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 991/1987] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:45.183187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f8a68-3004-44d5-a1b5-437f67ef0d77 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:45.183958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd37f1-8198-43c8-8c24-3242533cf7af None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:45.184277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd37f1-8198-43c8-8c24-3242533cf7af None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:45.184574 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd37f1-8198-43c8-8c24-3242533cf7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:45.192853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c74d5b-1261-4687-8a00-9b9630f66fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:45.193759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c74d5b-1261-4687-8a00-9b9630f66fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:45.194070 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c74d5b-1261-4687-8a00-9b9630f66fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:45.194383 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c74d5b-1261-4687-8a00-9b9630f66fd3 admin admin] PATH_INFO: `/v3/projects/a56cfa2c3f32411895840c42c69747c0/users/279abc10212a4da1ae7169726a484278/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:45.196849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c74d5b-1261-4687-8a00-9b9630f66fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56cfa2c3f32411895840c42c69747c0, user_id=279abc10212a4da1ae7169726a484278, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:45.199898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c74d5b-1261-4687-8a00-9b9630f66fd3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:45.211615 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 997/1988] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:45 2022] PUT /identity/v3/projects/a56cfa2c3f32411895840c42c69747c0/users/279abc10212a4da1ae7169726a484278/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:45.221419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-dcfd37f1-8198-43c8-8c24-3242533cf7af None None] MFA Rules not processed for user `1efee9da856e44fe89041d50a42c778b`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:45.221679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c74d5b-1261-4687-8a00-9b9630f66fd3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:45.221758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-dcfd37f1-8198-43c8-8c24-3242533cf7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:45.221828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c5c74d5b-1261-4687-8a00-9b9630f66fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:45.282561 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c74d5b-1261-4687-8a00-9b9630f66fd3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:45.286733 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d2a45-1ac0-4298-af5c-653cc514b8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:45.287370 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d2a45-1ac0-4298-af5c-653cc514b8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:45.287704 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d2a45-1ac0-4298-af5c-653cc514b8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:45.288497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d2a45-1ac0-4298-af5c-653cc514b8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:45.310421 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 992/1989] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:45.312335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85336a8-d5f0-495f-a0a6-f863687a1e42 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:45.313188 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85336a8-d5f0-495f-a0a6-f863687a1e42 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:45.314126 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85336a8-d5f0-495f-a0a6-f863687a1e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:45.353854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-d85336a8-d5f0-495f-a0a6-f863687a1e42 None None] MFA Rules not processed for user `279abc10212a4da1ae7169726a484278`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:45.355719 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d85336a8-d5f0-495f-a0a6-f863687a1e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:45.399015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d2a45-1ac0-4298-af5c-653cc514b8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:45.400486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d2a45-1ac0-4298-af5c-653cc514b8b9 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:45.410511 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 998/1990] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:45.411342 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d2a45-1ac0-4298-af5c-653cc514b8b9 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:45.453167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 993/1991] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:45.479386 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85336a8-d5f0-495f-a0a6-f863687a1e42 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:45.481359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d85336a8-d5f0-495f-a0a6-f863687a1e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:45.486750 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d2a45-1ac0-4298-af5c-653cc514b8b9 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:45.491634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397521-e6f9-41e2-9f87-0150e6ad339f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:45.492353 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397521-e6f9-41e2-9f87-0150e6ad339f service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:45.492658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397521-e6f9-41e2-9f87-0150e6ad339f service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:45.492946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397521-e6f9-41e2-9f87-0150e6ad339f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:45.497795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85336a8-d5f0-495f-a0a6-f863687a1e42 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:45.501832 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe0f22-8974-4687-805b-51bcbefa4e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:45.502513 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe0f22-8974-4687-805b-51bcbefa4e6a service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:45.502797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe0f22-8974-4687-805b-51bcbefa4e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:45.503069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe0f22-8974-4687-805b-51bcbefa4e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:45.505552 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb397521-e6f9-41e2-9f87-0150e6ad339f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:45.509603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb397521-e6f9-41e2-9f87-0150e6ad339f service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:45.514106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe0f22-8974-4687-805b-51bcbefa4e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:45.515570 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe0f22-8974-4687-805b-51bcbefa4e6a service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:45.524051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 999/1992] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:45.526266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 994/1993] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:45 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:45.601547 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397521-e6f9-41e2-9f87-0150e6ad339f service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:45.611542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397521-e6f9-41e2-9f87-0150e6ad339f service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:45.615863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d4217-f436-4ce9-8532-3c1ec9e65521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:45.617348 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d4217-f436-4ce9-8532-3c1ec9e65521 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:45.617656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d4217-f436-4ce9-8532-3c1ec9e65521 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:45.617897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d4217-f436-4ce9-8532-3c1ec9e65521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:45.642413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe0f22-8974-4687-805b-51bcbefa4e6a service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:45.654387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe0f22-8974-4687-805b-51bcbefa4e6a service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:45.668613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2c7f2-5d8e-4a0d-88b8-0a0d961ddcea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:45.669269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2c7f2-5d8e-4a0d-88b8-0a0d961ddcea service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:45.669550 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2c7f2-5d8e-4a0d-88b8-0a0d961ddcea service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:45.669823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2c7f2-5d8e-4a0d-88b8-0a0d961ddcea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:45.700780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d4217-f436-4ce9-8532-3c1ec9e65521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:45.702899 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d4217-f436-4ce9-8532-3c1ec9e65521 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:45.714846 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1000/1994] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:45.732707 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2c7f2-5d8e-4a0d-88b8-0a0d961ddcea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:45.734469 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2c7f2-5d8e-4a0d-88b8-0a0d961ddcea service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:45.745146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 995/1995] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:45 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:46.252498 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d4217-f436-4ce9-8532-3c1ec9e65521 service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:46.254077 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3d4d4217-f436-4ce9-8532-3c1ec9e65521 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:46.287546 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d4217-f436-4ce9-8532-3c1ec9e65521 service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:46.302454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933f0ca-4a7b-4fa0-ae5b-264d0b871d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:46.302951 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933f0ca-4a7b-4fa0-ae5b-264d0b871d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:46.303302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933f0ca-4a7b-4fa0-ae5b-264d0b871d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:46.303604 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933f0ca-4a7b-4fa0-ae5b-264d0b871d5a admin admin] PATH_INFO: `/v3/users/d8edd2ec587540698c3743ad043da805` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:46.304841 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933f0ca-4a7b-4fa0-ae5b-264d0b871d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8edd2ec587540698c3743ad043da805)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:46.306800 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933f0ca-4a7b-4fa0-ae5b-264d0b871d5a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:46.406294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a933f0ca-4a7b-4fa0-ae5b-264d0b871d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8edd2ec587540698c3743ad043da805'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:46.416769 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a933f0ca-4a7b-4fa0-ae5b-264d0b871d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8edd2ec587540698c3743ad043da805'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:46.431811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a933f0ca-4a7b-4fa0-ae5b-264d0b871d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8edd2ec587540698c3743ad043da805'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:46.432604 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a933f0ca-4a7b-4fa0-ae5b-264d0b871d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8edd2ec587540698c3743ad043da805'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:46.441863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a933f0ca-4a7b-4fa0-ae5b-264d0b871d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8edd2ec587540698c3743ad043da805'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:46.452063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1001/1996] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:46 2022] DELETE /identity/v3/users/d8edd2ec587540698c3743ad043da805 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:46.454052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe99d6-a30e-43f4-90e4-0ac9f5d959bb None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:46.454840 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe99d6-a30e-43f4-90e4-0ac9f5d959bb None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:46.454840 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe99d6-a30e-43f4-90e4-0ac9f5d959bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:46.476871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00624c4-aef1-486b-8c7d-1187cecfe577 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:46.477234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00624c4-aef1-486b-8c7d-1187cecfe577 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:46.477584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00624c4-aef1-486b-8c7d-1187cecfe577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:46.487562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-7afe99d6-a30e-43f4-90e4-0ac9f5d959bb None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:46.489572 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-7afe99d6-a30e-43f4-90e4-0ac9f5d959bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:46.532967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-f00624c4-aef1-486b-8c7d-1187cecfe577 None None] MFA Rules not processed for user `2675a53d6286472895674a3be54131b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:46.534179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f00624c4-aef1-486b-8c7d-1187cecfe577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:46.594226 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 996/1997] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:46.611752 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe99d6-a30e-43f4-90e4-0ac9f5d959bb None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:46.613209 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-7afe99d6-a30e-43f4-90e4-0ac9f5d959bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:46.641118 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1002/1998] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:46.651882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00624c4-aef1-486b-8c7d-1187cecfe577 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:46.654049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f00624c4-aef1-486b-8c7d-1187cecfe577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:46.726091 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe99d6-a30e-43f4-90e4-0ac9f5d959bb None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:46.731496 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29fee7-ec43-4f7f-9fac-4642dd51b622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:46.734551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29fee7-ec43-4f7f-9fac-4642dd51b622 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:46.735044 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29fee7-ec43-4f7f-9fac-4642dd51b622 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:46.735472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29fee7-ec43-4f7f-9fac-4642dd51b622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:46.746695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29fee7-ec43-4f7f-9fac-4642dd51b622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:46.747673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00624c4-aef1-486b-8c7d-1187cecfe577 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:46.748269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29fee7-ec43-4f7f-9fac-4642dd51b622 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:46.752405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f3d6c-0225-4c54-b492-81622054d63a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:46.753072 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f3d6c-0225-4c54-b492-81622054d63a service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:46.753524 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f3d6c-0225-4c54-b492-81622054d63a service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:46.753805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f3d6c-0225-4c54-b492-81622054d63a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:46.759599 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 997/1999] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:38:46.762824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f3d6c-0225-4c54-b492-81622054d63a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:46.765037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f3d6c-0225-4c54-b492-81622054d63a service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:46.776759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1003/2000] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:47.160911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29fee7-ec43-4f7f-9fac-4642dd51b622 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:47.163808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-df29fee7-ec43-4f7f-9fac-4642dd51b622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:47.178423 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29fee7-ec43-4f7f-9fac-4642dd51b622 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:47.191119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:47.192131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:47.192477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:47.192878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] PATH_INFO: `/v3/projects/2aa705a6a2b64f3a9dbcd2c22b53f813` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:47.194618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa705a6a2b64f3a9dbcd2c22b53f813)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:47.196603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:47.251091 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa705a6a2b64f3a9dbcd2c22b53f813', 'request_id': 'req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:47.258178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa705a6a2b64f3a9dbcd2c22b53f813', 'request_id': 'req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:47.267069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa705a6a2b64f3a9dbcd2c22b53f813', 'request_id': 'req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:47.279353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] The token cache is being invalidate because project 2aa705a6a2b64f3a9dbcd2c22b53f813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:47.279644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:47.280297 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:47.282247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 998/2001] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:47 2022] DELETE /identity/v3/projects/2aa705a6a2b64f3a9dbcd2c22b53f813 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:47.285670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f3d6c-0225-4c54-b492-81622054d63a service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:47.298566 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f3d6c-0225-4c54-b492-81622054d63a service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:47.389075 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862a4f9-6659-4d9f-9fe3-5a6ae9e3df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:47.389967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862a4f9-6659-4d9f-9fe3-5a6ae9e3df36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:47.390296 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862a4f9-6659-4d9f-9fe3-5a6ae9e3df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:47.390580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862a4f9-6659-4d9f-9fe3-5a6ae9e3df36 admin admin] PATH_INFO: `/v3/users/66447d6a788b40f68d98cc6049e1116f` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:47.391805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862a4f9-6659-4d9f-9fe3-5a6ae9e3df36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66447d6a788b40f68d98cc6049e1116f)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:47.394763 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862a4f9-6659-4d9f-9fe3-5a6ae9e3df36 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:47.465569 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2862a4f9-6659-4d9f-9fe3-5a6ae9e3df36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66447d6a788b40f68d98cc6049e1116f'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:47.485151 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2862a4f9-6659-4d9f-9fe3-5a6ae9e3df36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66447d6a788b40f68d98cc6049e1116f'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:47.494295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2862a4f9-6659-4d9f-9fe3-5a6ae9e3df36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66447d6a788b40f68d98cc6049e1116f'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:47.495189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2862a4f9-6659-4d9f-9fe3-5a6ae9e3df36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66447d6a788b40f68d98cc6049e1116f'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:47.504396 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-2862a4f9-6659-4d9f-9fe3-5a6ae9e3df36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66447d6a788b40f68d98cc6049e1116f'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:47.511470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1004/2002] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:47 2022] DELETE /identity/v3/users/66447d6a788b40f68d98cc6049e1116f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:47.840239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:47.841820 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:47.869025 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa14c82-2a1e-4855-bc6f-f5cb5df37153 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:47.985619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:47.995782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:47.995782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:47.995782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb admin admin] PATH_INFO: `/v3/projects/0361212d89bd4222a0dd54b8172161c0` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:48.004183 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0361212d89bd4222a0dd54b8172161c0)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:48.006119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:48.076987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0361212d89bd4222a0dd54b8172161c0', 'request_id': 'req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:48.084717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0361212d89bd4222a0dd54b8172161c0', 'request_id': 'req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:48.107686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0361212d89bd4222a0dd54b8172161c0', 'request_id': 'req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:48.130596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb admin admin] The token cache is being invalidate because project 0361212d89bd4222a0dd54b8172161c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:48.130781 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:48.132794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-1d43c9b0-8cfd-4286-82d6-37d100e7bcbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:48.135364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 999/2003] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:47 2022] DELETE /identity/v3/projects/0361212d89bd4222a0dd54b8172161c0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:48.140203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce64036-196f-491f-ba08-6ceb79f875ed None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:48.140512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce64036-196f-491f-ba08-6ceb79f875ed None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:48.141396 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce64036-196f-491f-ba08-6ceb79f875ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:48.161497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-bce64036-196f-491f-ba08-6ceb79f875ed None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:48.165216 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-bce64036-196f-491f-ba08-6ceb79f875ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:48.239983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1005/2004] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:48.259968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc116933-7a95-4192-bef6-decde7f0981d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:48.261034 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc116933-7a95-4192-bef6-decde7f0981d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:48.261383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc116933-7a95-4192-bef6-decde7f0981d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:48.288337 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a419a-126b-40e2-95d6-8db414aadc7d None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:48.288891 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a419a-126b-40e2-95d6-8db414aadc7d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:48.290974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a419a-126b-40e2-95d6-8db414aadc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:48.304502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-cc116933-7a95-4192-bef6-decde7f0981d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:48.305633 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-cc116933-7a95-4192-bef6-decde7f0981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:48.329832 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1000/2005] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:48.333755 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc116933-7a95-4192-bef6-decde7f0981d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:48.335064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-6a6a419a-126b-40e2-95d6-8db414aadc7d None None] MFA Rules not processed for user `2675a53d6286472895674a3be54131b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:48.339518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6a6a419a-126b-40e2-95d6-8db414aadc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:48.352693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc116933-7a95-4192-bef6-decde7f0981d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:48.364166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e407c5-0c7c-4ae1-a04b-a5c9fb7a6298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:48.366549 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e407c5-0c7c-4ae1-a04b-a5c9fb7a6298 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:48.367000 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e407c5-0c7c-4ae1-a04b-a5c9fb7a6298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:48.367566 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e407c5-0c7c-4ae1-a04b-a5c9fb7a6298 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:48.369888 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e407c5-0c7c-4ae1-a04b-a5c9fb7a6298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:48.374197 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e407c5-0c7c-4ae1-a04b-a5c9fb7a6298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:48.376037 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e407c5-0c7c-4ae1-a04b-a5c9fb7a6298 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:48.402691 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1001/2006] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:38:48.406881 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e407c5-0c7c-4ae1-a04b-a5c9fb7a6298 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:48.426432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e407c5-0c7c-4ae1-a04b-a5c9fb7a6298 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:48.439210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1006/2007] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:48.442342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa81b3f-4922-4dbd-8521-ff1b13bf1718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:48.443278 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa81b3f-4922-4dbd-8521-ff1b13bf1718 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:48.446796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa81b3f-4922-4dbd-8521-ff1b13bf1718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:48.447235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa81b3f-4922-4dbd-8521-ff1b13bf1718 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:48.448185 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa81b3f-4922-4dbd-8521-ff1b13bf1718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:48.450420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa81b3f-4922-4dbd-8521-ff1b13bf1718 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:48.487616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1002/2008] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:48 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:38:48.492037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a419a-126b-40e2-95d6-8db414aadc7d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:48.508371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a419a-126b-40e2-95d6-8db414aadc7d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:48.621459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b86a4-d622-4796-80a7-2ea4de0563bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:48.622544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b86a4-d622-4796-80a7-2ea4de0563bb admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:48.622997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b86a4-d622-4796-80a7-2ea4de0563bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:48.623491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b86a4-d622-4796-80a7-2ea4de0563bb admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:48.624306 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b86a4-d622-4796-80a7-2ea4de0563bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:48.628123 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b86a4-d622-4796-80a7-2ea4de0563bb admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:48.672837 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1007/2009] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:48 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:48.674477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa81b3f-4922-4dbd-8521-ff1b13bf1718 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:48.699688 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa81b3f-4922-4dbd-8521-ff1b13bf1718 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:48.712865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765362f2-1904-4b88-9af0-e81300874703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:48.713556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765362f2-1904-4b88-9af0-e81300874703 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:48.713837 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765362f2-1904-4b88-9af0-e81300874703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:48.714110 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765362f2-1904-4b88-9af0-e81300874703 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:48.714868 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765362f2-1904-4b88-9af0-e81300874703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:48.722497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765362f2-1904-4b88-9af0-e81300874703 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:48.746362 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1003/2010] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:48.752358 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b86a4-d622-4796-80a7-2ea4de0563bb admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:48.773083 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b86a4-d622-4796-80a7-2ea4de0563bb admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:48.789147 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e303faf-1047-48c6-8f9f-5e01d470c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:48.790340 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e303faf-1047-48c6-8f9f-5e01d470c4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:48.790898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e303faf-1047-48c6-8f9f-5e01d470c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:48.791236 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e303faf-1047-48c6-8f9f-5e01d470c4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:48.792241 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e303faf-1047-48c6-8f9f-5e01d470c4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:48.794416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e303faf-1047-48c6-8f9f-5e01d470c4c2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:48.836098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1008/2011] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:48.837558 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765362f2-1904-4b88-9af0-e81300874703 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:48.851499 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765362f2-1904-4b88-9af0-e81300874703 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:48.859514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3e4c4-0b25-4c90-9f99-f8dcdaf80898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:48.861197 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3e4c4-0b25-4c90-9f99-f8dcdaf80898 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:48.861873 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3e4c4-0b25-4c90-9f99-f8dcdaf80898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:48.862410 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3e4c4-0b25-4c90-9f99-f8dcdaf80898 admin admin] PATH_INFO: `/v3/projects/56b9e9d8076c46318d27009877186e1b/users/940cd3861302470f96aea8cde30748ad/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:48.893498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3e4c4-0b25-4c90-9f99-f8dcdaf80898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b9e9d8076c46318d27009877186e1b, user_id=940cd3861302470f96aea8cde30748ad, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:48.896318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3e4c4-0b25-4c90-9f99-f8dcdaf80898 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:48.927515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1004/2012] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:48 2022] PUT /identity/v3/projects/56b9e9d8076c46318d27009877186e1b/users/940cd3861302470f96aea8cde30748ad/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:48.941988 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17768afa-1d28-418f-b791-dcb3fff40ddb None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:48.942501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17768afa-1d28-418f-b791-dcb3fff40ddb None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:48.942908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17768afa-1d28-418f-b791-dcb3fff40ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:49.009150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-17768afa-1d28-418f-b791-dcb3fff40ddb None None] MFA Rules not processed for user `940cd3861302470f96aea8cde30748ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:49.010376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-17768afa-1d28-418f-b791-dcb3fff40ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:49.184282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1009/2013] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:49.185571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3e4c4-0b25-4c90-9f99-f8dcdaf80898 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:49.276472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3e4c4-0b25-4c90-9f99-f8dcdaf80898 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:49.282866 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e915e5-3cba-46c9-bccf-f93e751fbfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:49.283539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e915e5-3cba-46c9-bccf-f93e751fbfe6 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:49.284130 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e915e5-3cba-46c9-bccf-f93e751fbfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:49.284130 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e915e5-3cba-46c9-bccf-f93e751fbfe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:49.284780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e915e5-3cba-46c9-bccf-f93e751fbfe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:49.288318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e915e5-3cba-46c9-bccf-f93e751fbfe6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:49.324580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1005/2014] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:49 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:49.325669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17768afa-1d28-418f-b791-dcb3fff40ddb None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:49.342095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17768afa-1d28-418f-b791-dcb3fff40ddb None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:49.454234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917165d3-6053-4f49-826e-5df73af9faa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:49.455062 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917165d3-6053-4f49-826e-5df73af9faa7 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:49.455383 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917165d3-6053-4f49-826e-5df73af9faa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:49.455773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917165d3-6053-4f49-826e-5df73af9faa7 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:49.456488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917165d3-6053-4f49-826e-5df73af9faa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:49.462180 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917165d3-6053-4f49-826e-5df73af9faa7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:49.519584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1010/2015] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:49 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:38:49.521776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e915e5-3cba-46c9-bccf-f93e751fbfe6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:49.534777 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e915e5-3cba-46c9-bccf-f93e751fbfe6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:49.541205 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c527e7-0fec-4940-b656-593d8e651fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:49.542375 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c527e7-0fec-4940-b656-593d8e651fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:49.542894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c527e7-0fec-4940-b656-593d8e651fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:49.543385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c527e7-0fec-4940-b656-593d8e651fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:49.544335 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c527e7-0fec-4940-b656-593d8e651fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:49.557249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c527e7-0fec-4940-b656-593d8e651fc6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:49.563825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917165d3-6053-4f49-826e-5df73af9faa7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:49.565937 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-917165d3-6053-4f49-826e-5df73af9faa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:49.587790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1006/2016] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:38:49.590164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c527e7-0fec-4940-b656-593d8e651fc6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:49.616690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c527e7-0fec-4940-b656-593d8e651fc6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:49.626568 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9d924-84d2-4745-8f32-a4a2cafc1b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:49.628379 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9d924-84d2-4745-8f32-a4a2cafc1b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:49.630949 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9d924-84d2-4745-8f32-a4a2cafc1b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:49.632584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9d924-84d2-4745-8f32-a4a2cafc1b54 admin admin] PATH_INFO: `/v3/projects/df8674e0a24f484fa20e2c21f99eec8b/users/01557c9e68b944e6b03ace84e87d2dc6/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:49.657576 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9d924-84d2-4745-8f32-a4a2cafc1b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8674e0a24f484fa20e2c21f99eec8b, user_id=01557c9e68b944e6b03ace84e87d2dc6, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:49.661241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9d924-84d2-4745-8f32-a4a2cafc1b54 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:49.683212 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1007/2017] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:49 2022] PUT /identity/v3/projects/df8674e0a24f484fa20e2c21f99eec8b/users/01557c9e68b944e6b03ace84e87d2dc6/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:49.687695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9d924-84d2-4745-8f32-a4a2cafc1b54 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:49.690575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917165d3-6053-4f49-826e-5df73af9faa7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:49.773235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9d924-84d2-4745-8f32-a4a2cafc1b54 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:49.780013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a655525-e487-46f8-adcf-c6d1613de761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:49.781116 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a655525-e487-46f8-adcf-c6d1613de761 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:49.781478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a655525-e487-46f8-adcf-c6d1613de761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:49.782238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a655525-e487-46f8-adcf-c6d1613de761 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:49.783369 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a655525-e487-46f8-adcf-c6d1613de761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:49.785685 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a655525-e487-46f8-adcf-c6d1613de761 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:49.790472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161c80f-e9a8-4af0-b3a3-cfe651c00b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:49.791210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161c80f-e9a8-4af0-b3a3-cfe651c00b8c service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:49.791588 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161c80f-e9a8-4af0-b3a3-cfe651c00b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:49.792257 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161c80f-e9a8-4af0-b3a3-cfe651c00b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:49.795155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8161c80f-e9a8-4af0-b3a3-cfe651c00b8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:49.799171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1008/2018] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:49.805336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a655525-e487-46f8-adcf-c6d1613de761 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:49.820593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a655525-e487-46f8-adcf-c6d1613de761 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:49.829870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b12c8-c230-497f-b4c7-d86cd839d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:49.831487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b12c8-c230-497f-b4c7-d86cd839d2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:49.831985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b12c8-c230-497f-b4c7-d86cd839d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:49.832764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b12c8-c230-497f-b4c7-d86cd839d2f7 admin admin] PATH_INFO: `/v3/projects/df8674e0a24f484fa20e2c21f99eec8b/users/01557c9e68b944e6b03ace84e87d2dc6/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:49.855998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b12c8-c230-497f-b4c7-d86cd839d2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8674e0a24f484fa20e2c21f99eec8b, user_id=01557c9e68b944e6b03ace84e87d2dc6, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:49.859702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b12c8-c230-497f-b4c7-d86cd839d2f7 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:49.882722 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1009/2019] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:49 2022] PUT /identity/v3/projects/df8674e0a24f484fa20e2c21f99eec8b/users/01557c9e68b944e6b03ace84e87d2dc6/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:49.896197 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b12c8-c230-497f-b4c7-d86cd839d2f7 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:49.900079 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-731b12c8-c230-497f-b4c7-d86cd839d2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:49.933321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161c80f-e9a8-4af0-b3a3-cfe651c00b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:49.935732 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161c80f-e9a8-4af0-b3a3-cfe651c00b8c service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:49.953576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1011/2020] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:38:49.955268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d094706-9184-46dd-a803-2af53cbaa5ee None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:49.956254 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d094706-9184-46dd-a803-2af53cbaa5ee None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:49.956744 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d094706-9184-46dd-a803-2af53cbaa5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:49.988539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b12c8-c230-497f-b4c7-d86cd839d2f7 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:49.995131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888a4a1-7076-4684-b55f-c93dc59bcffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:49.995776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-9d094706-9184-46dd-a803-2af53cbaa5ee None None] MFA Rules not processed for user `01557c9e68b944e6b03ace84e87d2dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:49.996359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888a4a1-7076-4684-b55f-c93dc59bcffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:49.996853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888a4a1-7076-4684-b55f-c93dc59bcffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:49.997222 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888a4a1-7076-4684-b55f-c93dc59bcffd admin admin] PATH_INFO: `/v3/users/cc619157a38d469ba44b78345cb5cff3` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:49.997860 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9d094706-9184-46dd-a803-2af53cbaa5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:49.999333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888a4a1-7076-4684-b55f-c93dc59bcffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc619157a38d469ba44b78345cb5cff3)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:50.000672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888a4a1-7076-4684-b55f-c93dc59bcffd admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:50.129734 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1012/2021] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:50.154599 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-3888a4a1-7076-4684-b55f-c93dc59bcffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc619157a38d469ba44b78345cb5cff3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:50.190503 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-3888a4a1-7076-4684-b55f-c93dc59bcffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc619157a38d469ba44b78345cb5cff3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:50.218188 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d094706-9184-46dd-a803-2af53cbaa5ee None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:50.219978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9d094706-9184-46dd-a803-2af53cbaa5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:50.260638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-3888a4a1-7076-4684-b55f-c93dc59bcffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc619157a38d469ba44b78345cb5cff3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:50.261945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-3888a4a1-7076-4684-b55f-c93dc59bcffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc619157a38d469ba44b78345cb5cff3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:50.263529 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-3888a4a1-7076-4684-b55f-c93dc59bcffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc619157a38d469ba44b78345cb5cff3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:50.292047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1010/2022] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:49 2022] DELETE /identity/v3/users/cc619157a38d469ba44b78345cb5cff3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:50.297514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875b148-15ae-48c5-82d1-ab7d1425196a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:50.297514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875b148-15ae-48c5-82d1-ab7d1425196a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:50.297514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875b148-15ae-48c5-82d1-ab7d1425196a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:50.349306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e875b148-15ae-48c5-82d1-ab7d1425196a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:50.349707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d094706-9184-46dd-a803-2af53cbaa5ee None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:50.352313 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e875b148-15ae-48c5-82d1-ab7d1425196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:50.498625 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe91f47-a540-492f-9dcf-b6cf70547e3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:50.499811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe91f47-a540-492f-9dcf-b6cf70547e3f service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:50.500352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe91f47-a540-492f-9dcf-b6cf70547e3f service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:50.502024 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe91f47-a540-492f-9dcf-b6cf70547e3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:50.504796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5fe91f47-a540-492f-9dcf-b6cf70547e3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:50.539420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1011/2023] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:50.550761 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875b148-15ae-48c5-82d1-ab7d1425196a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:50.555192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e875b148-15ae-48c5-82d1-ab7d1425196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:50.634805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe91f47-a540-492f-9dcf-b6cf70547e3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:50.638438 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe91f47-a540-492f-9dcf-b6cf70547e3f service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:50.705624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1013/2024] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:50.709365 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875b148-15ae-48c5-82d1-ab7d1425196a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:50.729659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d39d1-e007-433e-96ba-42fd07724de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:50.731677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d39d1-e007-433e-96ba-42fd07724de0 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:50.732123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d39d1-e007-433e-96ba-42fd07724de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:50.732492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d39d1-e007-433e-96ba-42fd07724de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:50.769429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d39d1-e007-433e-96ba-42fd07724de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:50.774276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d39d1-e007-433e-96ba-42fd07724de0 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:50.804333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1012/2025] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:51.328897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe91f47-a540-492f-9dcf-b6cf70547e3f service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:51.330634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5fe91f47-a540-492f-9dcf-b6cf70547e3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:51.361271 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe91f47-a540-492f-9dcf-b6cf70547e3f service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:51.369842 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:51.372854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:51.373175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:51.373436 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] PATH_INFO: `/v3/projects/d194dcea674143fb9a5f70532b8ed15f` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:51.375706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d194dcea674143fb9a5f70532b8ed15f)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:51.377817 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:51.437094 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd194dcea674143fb9a5f70532b8ed15f', 'request_id': 'req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:51.443328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd194dcea674143fb9a5f70532b8ed15f', 'request_id': 'req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:51.480518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd194dcea674143fb9a5f70532b8ed15f', 'request_id': 'req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:51.520397 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] The token cache is being invalidate because project d194dcea674143fb9a5f70532b8ed15f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:51.520973 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:51.521904 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:51.524503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1014/2026] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:51 2022] DELETE /identity/v3/projects/d194dcea674143fb9a5f70532b8ed15f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:51.528350 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d39d1-e007-433e-96ba-42fd07724de0 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:51.542699 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d39d1-e007-433e-96ba-42fd07724de0 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:51.677511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab014459-b62f-44fe-81b4-353897bb61e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:51.678906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014459-b62f-44fe-81b4-353897bb61e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:51.679390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014459-b62f-44fe-81b4-353897bb61e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:51.680016 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014459-b62f-44fe-81b4-353897bb61e2 admin admin] PATH_INFO: `/v3/users/1efee9da856e44fe89041d50a42c778b` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:51.681842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab014459-b62f-44fe-81b4-353897bb61e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1efee9da856e44fe89041d50a42c778b)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:51.684156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab014459-b62f-44fe-81b4-353897bb61e2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:51.778846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ab014459-b62f-44fe-81b4-353897bb61e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1efee9da856e44fe89041d50a42c778b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:51.788696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ab014459-b62f-44fe-81b4-353897bb61e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1efee9da856e44fe89041d50a42c778b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:51.812548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ab014459-b62f-44fe-81b4-353897bb61e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1efee9da856e44fe89041d50a42c778b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:51.813399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ab014459-b62f-44fe-81b4-353897bb61e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1efee9da856e44fe89041d50a42c778b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:51.814089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ab014459-b62f-44fe-81b4-353897bb61e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1efee9da856e44fe89041d50a42c778b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:51.848731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1013/2027] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:51 2022] DELETE /identity/v3/users/1efee9da856e44fe89041d50a42c778b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:52.170509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:52.172235 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:52.217713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bf8fe-aa90-4fcd-960c-b265ad6f1f17 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:52.372695 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:52.375276 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:52.375763 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:52.376244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] PATH_INFO: `/v3/users/940cd3861302470f96aea8cde30748ad` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:52.378233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=940cd3861302470f96aea8cde30748ad)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:52.380996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:52.537064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940cd3861302470f96aea8cde30748ad'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:52.559183 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940cd3861302470f96aea8cde30748ad'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:52.579406 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940cd3861302470f96aea8cde30748ad'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:52.581373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940cd3861302470f96aea8cde30748ad'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:52.599210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940cd3861302470f96aea8cde30748ad'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:52.614166 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1015/2028] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:52 2022] DELETE /identity/v3/users/940cd3861302470f96aea8cde30748ad => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:52.619542 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6d16-e2f4-432c-abf8-597c80a583fa None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:52.620581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6d16-e2f4-432c-abf8-597c80a583fa None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:52.621014 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6d16-e2f4-432c-abf8-597c80a583fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:52.681920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f90c6d16-e2f4-432c-abf8-597c80a583fa None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:52.683656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f90c6d16-e2f4-432c-abf8-597c80a583fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:52.879624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1014/2029] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:52.916854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:52.922049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:53.089138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34360ca9-8b65-4dc0-b73f-51a81c0359f0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:53.104911 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249a02e-6563-4802-ac2d-0a974f273e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:53.105977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249a02e-6563-4802-ac2d-0a974f273e62 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:53.106557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249a02e-6563-4802-ac2d-0a974f273e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:53.107146 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249a02e-6563-4802-ac2d-0a974f273e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:53.127248 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249a02e-6563-4802-ac2d-0a974f273e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:53.130314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249a02e-6563-4802-ac2d-0a974f273e62 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:53.163508 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1016/2030] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:53.429917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c6d16-e2f4-432c-abf8-597c80a583fa None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:53.432126 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f90c6d16-e2f4-432c-abf8-597c80a583fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:53.452608 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c6d16-e2f4-432c-abf8-597c80a583fa None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:53.469241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e1ef6-1ac4-4e8b-b932-7357fe22c878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:53.470244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1ef6-1ac4-4e8b-b932-7357fe22c878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:53.470541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1ef6-1ac4-4e8b-b932-7357fe22c878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:53.470908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1ef6-1ac4-4e8b-b932-7357fe22c878 admin admin] PATH_INFO: `/v3/projects/12635f9ac4cf4650be677998deedc410` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:53.472578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e1ef6-1ac4-4e8b-b932-7357fe22c878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12635f9ac4cf4650be677998deedc410)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:53.474540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e1ef6-1ac4-4e8b-b932-7357fe22c878 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:53.575618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-107e1ef6-1ac4-4e8b-b932-7357fe22c878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12635f9ac4cf4650be677998deedc410', 'request_id': 'req-107e1ef6-1ac4-4e8b-b932-7357fe22c878'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:53.586275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-107e1ef6-1ac4-4e8b-b932-7357fe22c878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12635f9ac4cf4650be677998deedc410', 'request_id': 'req-107e1ef6-1ac4-4e8b-b932-7357fe22c878'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:53.599467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-107e1ef6-1ac4-4e8b-b932-7357fe22c878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12635f9ac4cf4650be677998deedc410', 'request_id': 'req-107e1ef6-1ac4-4e8b-b932-7357fe22c878'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:53.621084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-107e1ef6-1ac4-4e8b-b932-7357fe22c878 admin admin] The token cache is being invalidate because project 12635f9ac4cf4650be677998deedc410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:53.621679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-107e1ef6-1ac4-4e8b-b932-7357fe22c878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:53.622454 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-107e1ef6-1ac4-4e8b-b932-7357fe22c878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:53.625657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1015/2031] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:53 2022] DELETE /identity/v3/projects/12635f9ac4cf4650be677998deedc410 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:53.630290 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429348-498f-4bf6-b4b9-5d85edfd7607 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:53.631659 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429348-498f-4bf6-b4b9-5d85edfd7607 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:53.632174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429348-498f-4bf6-b4b9-5d85edfd7607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:53.671767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-40429348-498f-4bf6-b4b9-5d85edfd7607 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:53.672803 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-40429348-498f-4bf6-b4b9-5d85edfd7607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:53.757996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1017/2032] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:53.759666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccafee5-1841-487a-80b0-25cce628f7c6 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:53.759959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccafee5-1841-487a-80b0-25cce628f7c6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:53.760246 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccafee5-1841-487a-80b0-25cce628f7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:53.805880 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-3ccafee5-1841-487a-80b0-25cce628f7c6 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:53.809614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3ccafee5-1841-487a-80b0-25cce628f7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:53.834884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1016/2033] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:53.839326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429348-498f-4bf6-b4b9-5d85edfd7607 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:53.853187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429348-498f-4bf6-b4b9-5d85edfd7607 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:53.859685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8942704-db31-4829-86fa-3f97ad1839ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:53.864817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccafee5-1841-487a-80b0-25cce628f7c6 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:53.865522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8942704-db31-4829-86fa-3f97ad1839ed admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:53.866010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8942704-db31-4829-86fa-3f97ad1839ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:53.866428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3ccafee5-1841-487a-80b0-25cce628f7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:53.866726 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8942704-db31-4829-86fa-3f97ad1839ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:53.867659 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8942704-db31-4829-86fa-3f97ad1839ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:53.868454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8942704-db31-4829-86fa-3f97ad1839ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:53.875278 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8942704-db31-4829-86fa-3f97ad1839ed admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:53.898606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccafee5-1841-487a-80b0-25cce628f7c6 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:53.905921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1018/2034] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:53.906838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:53.907294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8942704-db31-4829-86fa-3f97ad1839ed admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:53.907964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:53.908459 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:53.908846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] PATH_INFO: `/v3/projects/56b9e9d8076c46318d27009877186e1b` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:53.911809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b9e9d8076c46318d27009877186e1b)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:53.915595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:53.923013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8942704-db31-4829-86fa-3f97ad1839ed admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:53.929563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84011d9-4bf4-4e64-a8b3-5c7f20619e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:53.930672 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84011d9-4bf4-4e64-a8b3-5c7f20619e38 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:53.930967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84011d9-4bf4-4e64-a8b3-5c7f20619e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:53.931263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84011d9-4bf4-4e64-a8b3-5c7f20619e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:53.931987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84011d9-4bf4-4e64-a8b3-5c7f20619e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:53.933897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84011d9-4bf4-4e64-a8b3-5c7f20619e38 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:53.988491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1019/2035] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:53 2022] POST /identity/v3/projects => generated 391 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:53.989501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84011d9-4bf4-4e64-a8b3-5c7f20619e38 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:54.001409 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b9e9d8076c46318d27009877186e1b', 'request_id': 'req-701a2e15-3948-4039-804e-6a24b4129e17'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:54.009420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b9e9d8076c46318d27009877186e1b', 'request_id': 'req-701a2e15-3948-4039-804e-6a24b4129e17'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:54.019384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b9e9d8076c46318d27009877186e1b', 'request_id': 'req-701a2e15-3948-4039-804e-6a24b4129e17'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:54.037672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] The token cache is being invalidate because project 56b9e9d8076c46318d27009877186e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:54.038319 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:54.039313 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:54.041147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1017/2036] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:53 2022] DELETE /identity/v3/projects/56b9e9d8076c46318d27009877186e1b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:54.046659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:54.048694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:54.071489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84011d9-4bf4-4e64-a8b3-5c7f20619e38 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:54.165574 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a2e15-3948-4039-804e-6a24b4129e17 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:54.190733 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51774b73-4f18-4be2-9064-e06419f2260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:54.193215 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51774b73-4f18-4be2-9064-e06419f2260b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:54.202630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1598c-5aa9-4524-9ca6-fcfc8f5c94b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:54.203718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1598c-5aa9-4524-9ca6-fcfc8f5c94b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:54.204104 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1598c-5aa9-4524-9ca6-fcfc8f5c94b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:54.204484 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1598c-5aa9-4524-9ca6-fcfc8f5c94b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:54.204772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51774b73-4f18-4be2-9064-e06419f2260b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:54.205478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1598c-5aa9-4524-9ca6-fcfc8f5c94b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:54.205998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51774b73-4f18-4be2-9064-e06419f2260b admin admin] PATH_INFO: `/v3/users/01557c9e68b944e6b03ace84e87d2dc6` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:54.208048 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1598c-5aa9-4524-9ca6-fcfc8f5c94b3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:54.211049 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51774b73-4f18-4be2-9064-e06419f2260b admin admin] RBAC: Authorizing `identity:delete_user(user_id=01557c9e68b944e6b03ace84e87d2dc6)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:54.213482 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51774b73-4f18-4be2-9064-e06419f2260b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:54.234068 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1020/2037] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:53 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:54.237754 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1598c-5aa9-4524-9ca6-fcfc8f5c94b3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:54.241018 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e4c1598c-5aa9-4524-9ca6-fcfc8f5c94b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:54.255761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1598c-5aa9-4524-9ca6-fcfc8f5c94b3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:54.267715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea925f-807d-470d-861e-8bc06cfeda1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:54.268477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea925f-807d-470d-861e-8bc06cfeda1d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:54.268730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea925f-807d-470d-861e-8bc06cfeda1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:54.269006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea925f-807d-470d-861e-8bc06cfeda1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:54.269746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea925f-807d-470d-861e-8bc06cfeda1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:54.271392 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea925f-807d-470d-861e-8bc06cfeda1d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:54.285780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1021/2038] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:54.289078 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-51774b73-4f18-4be2-9064-e06419f2260b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01557c9e68b944e6b03ace84e87d2dc6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:54.291574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea925f-807d-470d-861e-8bc06cfeda1d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:54.296084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-51774b73-4f18-4be2-9064-e06419f2260b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01557c9e68b944e6b03ace84e87d2dc6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:54.310261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea925f-807d-470d-861e-8bc06cfeda1d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:54.313905 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-51774b73-4f18-4be2-9064-e06419f2260b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01557c9e68b944e6b03ace84e87d2dc6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:54.316793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-51774b73-4f18-4be2-9064-e06419f2260b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01557c9e68b944e6b03ace84e87d2dc6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:54.319244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-51774b73-4f18-4be2-9064-e06419f2260b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01557c9e68b944e6b03ace84e87d2dc6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:54.320485 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63f022-265e-4c91-830c-1c29f053f120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:54.321243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63f022-265e-4c91-830c-1c29f053f120 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:54.321748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63f022-265e-4c91-830c-1c29f053f120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:54.322025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63f022-265e-4c91-830c-1c29f053f120 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:54.323419 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63f022-265e-4c91-830c-1c29f053f120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:54.325491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63f022-265e-4c91-830c-1c29f053f120 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:54.338848 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1022/2039] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:54.348041 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63f022-265e-4c91-830c-1c29f053f120 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:54.348041 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-cb63f022-265e-4c91-830c-1c29f053f120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:54.348227 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1018/2040] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:54 2022] DELETE /identity/v3/users/01557c9e68b944e6b03ace84e87d2dc6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:54.366641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63f022-265e-4c91-830c-1c29f053f120 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:54.461683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbfb06-c2b4-4140-97ca-aa299cfe5c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:54.464027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbfb06-c2b4-4140-97ca-aa299cfe5c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:54.464314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbfb06-c2b4-4140-97ca-aa299cfe5c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:54.464587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbfb06-c2b4-4140-97ca-aa299cfe5c35 admin admin] PATH_INFO: `/v3/projects/c52e1975d28c42db97d338c25157f7c5/users/08bcf5a89af94826b4b4ae3510b5de2b/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:54.518537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbfb06-c2b4-4140-97ca-aa299cfe5c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52e1975d28c42db97d338c25157f7c5, user_id=08bcf5a89af94826b4b4ae3510b5de2b, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:54.524064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbfb06-c2b4-4140-97ca-aa299cfe5c35 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:54.563787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1023/2041] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:54 2022] PUT /identity/v3/projects/c52e1975d28c42db97d338c25157f7c5/users/08bcf5a89af94826b4b4ae3510b5de2b/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:54.576332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c02bc-007b-47df-9d47-e26df3d74432 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:54.576637 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c02bc-007b-47df-9d47-e26df3d74432 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:54.576946 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c02bc-007b-47df-9d47-e26df3d74432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:54.621410 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-c99c02bc-007b-47df-9d47-e26df3d74432 None None] MFA Rules not processed for user `08bcf5a89af94826b4b4ae3510b5de2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:54.623214 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c99c02bc-007b-47df-9d47-e26df3d74432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:54.717151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1019/2042] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:54.721064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbfb06-c2b4-4140-97ca-aa299cfe5c35 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:54.811178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbfb06-c2b4-4140-97ca-aa299cfe5c35 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:54.816043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68f2ac-9ece-4ce1-98d8-c69c3b228473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:54.816710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f2ac-9ece-4ce1-98d8-c69c3b228473 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:54.816996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f2ac-9ece-4ce1-98d8-c69c3b228473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:54.817268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f2ac-9ece-4ce1-98d8-c69c3b228473 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:54.817965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68f2ac-9ece-4ce1-98d8-c69c3b228473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:54.820551 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68f2ac-9ece-4ce1-98d8-c69c3b228473 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:54.848682 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1024/2043] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:54 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:54.852992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c02bc-007b-47df-9d47-e26df3d74432 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:54.864750 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c02bc-007b-47df-9d47-e26df3d74432 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:54.947705 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb33f-6d50-48f4-a7f6-c29b9eccde2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:54.950392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb33f-6d50-48f4-a7f6-c29b9eccde2f admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:54.950392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb33f-6d50-48f4-a7f6-c29b9eccde2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:54.950392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb33f-6d50-48f4-a7f6-c29b9eccde2f admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:54.950392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cb33f-6d50-48f4-a7f6-c29b9eccde2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:54.951541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cb33f-6d50-48f4-a7f6-c29b9eccde2f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:54.973457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1020/2044] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:54 2022] POST /identity/v3/users => generated 302 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:54.977807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68f2ac-9ece-4ce1-98d8-c69c3b228473 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:54.987666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb33f-6d50-48f4-a7f6-c29b9eccde2f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:54.991799 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5c5cb33f-6d50-48f4-a7f6-c29b9eccde2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:54.994432 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68f2ac-9ece-4ce1-98d8-c69c3b228473 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.014077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb33f-6d50-48f4-a7f6-c29b9eccde2f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.019426 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.020631 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.021071 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.021582 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de admin admin] PATH_INFO: `/v3/projects/df8674e0a24f484fa20e2c21f99eec8b` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.023242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8674e0a24f484fa20e2c21f99eec8b)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.025813 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.029871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc90710-d847-4b18-82e5-d03d066cac4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.030590 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90710-d847-4b18-82e5-d03d066cac4a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.030856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90710-d847-4b18-82e5-d03d066cac4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.031776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90710-d847-4b18-82e5-d03d066cac4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.032538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc90710-d847-4b18-82e5-d03d066cac4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.042930 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc90710-d847-4b18-82e5-d03d066cac4a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.058640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1025/2045] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:55.063075 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc90710-d847-4b18-82e5-d03d066cac4a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:55.081016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc90710-d847-4b18-82e5-d03d066cac4a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.086682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8674e0a24f484fa20e2c21f99eec8b', 'request_id': 'req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:55.097179 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8674e0a24f484fa20e2c21f99eec8b', 'request_id': 'req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:55.109980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8674e0a24f484fa20e2c21f99eec8b', 'request_id': 'req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:55.128363 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de admin admin] The token cache is being invalidate because project df8674e0a24f484fa20e2c21f99eec8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:55.129922 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:55.132751 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-9014dfc5-2f2a-4ab4-a7b2-cc31b28803de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:55.135258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1021/2046] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:54 2022] DELETE /identity/v3/projects/df8674e0a24f484fa20e2c21f99eec8b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:55.142811 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20090a-5026-4ece-a84a-859fdd08731d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.143316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20090a-5026-4ece-a84a-859fdd08731d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.143771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20090a-5026-4ece-a84a-859fdd08731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.167337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2a20090a-5026-4ece-a84a-859fdd08731d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:55.168690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2a20090a-5026-4ece-a84a-859fdd08731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:55.173401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15e9a1-a238-40cc-88be-f22e1d226751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.175286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15e9a1-a238-40cc-88be-f22e1d226751 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.175700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15e9a1-a238-40cc-88be-f22e1d226751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.176047 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15e9a1-a238-40cc-88be-f22e1d226751 admin admin] PATH_INFO: `/v3/projects/1da7ecfcb7f34d30b2a17cd86e362a8f/users/b9ccdf53023945de8cb02fc202e2f32a/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.178848 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1022/2047] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:55.186727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13a4e4-e026-4ccf-aca6-5cde7cd41b80 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.187262 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13a4e4-e026-4ccf-aca6-5cde7cd41b80 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.187728 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13a4e4-e026-4ccf-aca6-5cde7cd41b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.199436 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15e9a1-a238-40cc-88be-f22e1d226751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da7ecfcb7f34d30b2a17cd86e362a8f, user_id=b9ccdf53023945de8cb02fc202e2f32a, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.204800 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15e9a1-a238-40cc-88be-f22e1d226751 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.208573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-3b13a4e4-e026-4ccf-aca6-5cde7cd41b80 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:55.210376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-3b13a4e4-e026-4ccf-aca6-5cde7cd41b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:55.219912 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1023/2048] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:55.223927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13a4e4-e026-4ccf-aca6-5cde7cd41b80 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:55.227684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1026/2049] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:55 2022] PUT /identity/v3/projects/1da7ecfcb7f34d30b2a17cd86e362a8f/users/b9ccdf53023945de8cb02fc202e2f32a/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:55.232587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15e9a1-a238-40cc-88be-f22e1d226751 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:55.234775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1a15e9a1-a238-40cc-88be-f22e1d226751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:55.239932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13a4e4-e026-4ccf-aca6-5cde7cd41b80 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.316263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15e9a1-a238-40cc-88be-f22e1d226751 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.324611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0c0c2-a34c-4040-8691-08a64a5f6a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.325295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0c0c2-a34c-4040-8691-08a64a5f6a1e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.325627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0c0c2-a34c-4040-8691-08a64a5f6a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.325902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0c0c2-a34c-4040-8691-08a64a5f6a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.326717 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0c0c2-a34c-4040-8691-08a64a5f6a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.328504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0c0c2-a34c-4040-8691-08a64a5f6a1e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.338385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99254865-7f56-4d36-af13-34811e846719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.339075 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99254865-7f56-4d36-af13-34811e846719 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.339360 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99254865-7f56-4d36-af13-34811e846719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.343439 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99254865-7f56-4d36-af13-34811e846719 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.343573 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1027/2050] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:55.343689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99254865-7f56-4d36-af13-34811e846719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:55.343689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99254865-7f56-4d36-af13-34811e846719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.343689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99254865-7f56-4d36-af13-34811e846719 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.345104 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0c0c2-a34c-4040-8691-08a64a5f6a1e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:55.359540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0c0c2-a34c-4040-8691-08a64a5f6a1e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.362219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1024/2051] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:55.363326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99254865-7f56-4d36-af13-34811e846719 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:55.367334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6fed6-b70f-4f4d-a8dd-9806add950aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.368563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6fed6-b70f-4f4d-a8dd-9806add950aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.368780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6fed6-b70f-4f4d-a8dd-9806add950aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.369055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6fed6-b70f-4f4d-a8dd-9806add950aa admin admin] PATH_INFO: `/v3/projects/1da7ecfcb7f34d30b2a17cd86e362a8f/users/b9ccdf53023945de8cb02fc202e2f32a/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.372484 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6fed6-b70f-4f4d-a8dd-9806add950aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da7ecfcb7f34d30b2a17cd86e362a8f, user_id=b9ccdf53023945de8cb02fc202e2f32a, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.375524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99254865-7f56-4d36-af13-34811e846719 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.375882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6fed6-b70f-4f4d-a8dd-9806add950aa admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.380657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6c742-0119-4c2c-b7a7-17298dad6704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.381563 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6c742-0119-4c2c-b7a7-17298dad6704 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.381919 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6c742-0119-4c2c-b7a7-17298dad6704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.382308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6c742-0119-4c2c-b7a7-17298dad6704 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.383655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6c742-0119-4c2c-b7a7-17298dad6704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.386122 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6c742-0119-4c2c-b7a7-17298dad6704 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.388091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1028/2052] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:55 2022] PUT /identity/v3/projects/1da7ecfcb7f34d30b2a17cd86e362a8f/users/b9ccdf53023945de8cb02fc202e2f32a/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:38:55.399457 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ed86e-2077-46d9-b401-1a00aedfe421 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.400197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ed86e-2077-46d9-b401-1a00aedfe421 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.400509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ed86e-2077-46d9-b401-1a00aedfe421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.424938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1025/2053] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:55 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:55.429579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6c742-0119-4c2c-b7a7-17298dad6704 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:55.439241 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-ec6ed86e-2077-46d9-b401-1a00aedfe421 None None] MFA Rules not processed for user `b9ccdf53023945de8cb02fc202e2f32a`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:55.441077 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ec6ed86e-2077-46d9-b401-1a00aedfe421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:55.503762 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6c742-0119-4c2c-b7a7-17298dad6704 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.509392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3b26c-6e98-4675-8b83-a282adcdce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.510152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3b26c-6e98-4675-8b83-a282adcdce14 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.511009 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3b26c-6e98-4675-8b83-a282adcdce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.511391 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3b26c-6e98-4675-8b83-a282adcdce14 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.512200 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3b26c-6e98-4675-8b83-a282adcdce14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.514497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3b26c-6e98-4675-8b83-a282adcdce14 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.516058 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1029/2054] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:55.525860 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ed86e-2077-46d9-b401-1a00aedfe421 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:55.527887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ec6ed86e-2077-46d9-b401-1a00aedfe421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:55.555329 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1026/2055] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:55 2022] POST /identity/v3/users => generated 286 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:38:55.559094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3b26c-6e98-4675-8b83-a282adcdce14 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:55.569519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3b26c-6e98-4675-8b83-a282adcdce14 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.575694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402def03-2825-4128-9393-fdd77cfac656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.576365 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402def03-2825-4128-9393-fdd77cfac656 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.576649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402def03-2825-4128-9393-fdd77cfac656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.576923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402def03-2825-4128-9393-fdd77cfac656 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.577659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402def03-2825-4128-9393-fdd77cfac656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.579298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402def03-2825-4128-9393-fdd77cfac656 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.589392 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ed86e-2077-46d9-b401-1a00aedfe421 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.591802 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1027/2056] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:38:55.593743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402def03-2825-4128-9393-fdd77cfac656 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:55.594174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1abdc-86c4-42ee-b9e1-c1c36b00698b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.594856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1abdc-86c4-42ee-b9e1-c1c36b00698b service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.595140 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1abdc-86c4-42ee-b9e1-c1c36b00698b service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.595415 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1abdc-86c4-42ee-b9e1-c1c36b00698b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.604298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402def03-2825-4128-9393-fdd77cfac656 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.608212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1abdc-86c4-42ee-b9e1-c1c36b00698b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.609623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55dd04-28a4-42e4-8146-cb71739eb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.609777 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1abdc-86c4-42ee-b9e1-c1c36b00698b service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.610469 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55dd04-28a4-42e4-8146-cb71739eb7ba admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.610756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55dd04-28a4-42e4-8146-cb71739eb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.611182 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55dd04-28a4-42e4-8146-cb71739eb7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.612036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55dd04-28a4-42e4-8146-cb71739eb7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.613799 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55dd04-28a4-42e4-8146-cb71739eb7ba admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.623433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1030/2057] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:38:55.632672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1028/2058] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:55.633920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1abdc-86c4-42ee-b9e1-c1c36b00698b service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:55.645997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1abdc-86c4-42ee-b9e1-c1c36b00698b service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.654252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177b5bf-9b85-459f-a034-736cea53359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.655398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177b5bf-9b85-459f-a034-736cea53359e admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.655596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177b5bf-9b85-459f-a034-736cea53359e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.655808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177b5bf-9b85-459f-a034-736cea53359e admin admin] PATH_INFO: `/v3/projects/051960a04338446b9e1c8795ea5403ca/users/256859ab4bdb40479df9930501987edf/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.672937 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177b5bf-9b85-459f-a034-736cea53359e admin admin] RBAC: Authorizing `identity:create_grant(project_id=051960a04338446b9e1c8795ea5403ca, user_id=256859ab4bdb40479df9930501987edf, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.676095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177b5bf-9b85-459f-a034-736cea53359e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.681609 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55dd04-28a4-42e4-8146-cb71739eb7ba admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:55.683968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6e55dd04-28a4-42e4-8146-cb71739eb7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:55.692641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1031/2059] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:55 2022] PUT /identity/v3/projects/051960a04338446b9e1c8795ea5403ca/users/256859ab4bdb40479df9930501987edf/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:55.696474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55dd04-28a4-42e4-8146-cb71739eb7ba admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.703946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3fbd0-ae6d-47e9-b4e0-36c74549f4c9 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.704237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3fbd0-ae6d-47e9-b4e0-36c74549f4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.704519 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3fbd0-ae6d-47e9-b4e0-36c74549f4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.732641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-dcd3fbd0-ae6d-47e9-b4e0-36c74549f4c9 None None] MFA Rules not processed for user `256859ab4bdb40479df9930501987edf`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:55.733972 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-dcd3fbd0-ae6d-47e9-b4e0-36c74549f4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:55.748334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186addf-7d41-4da9-ab3e-291090481f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.748982 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186addf-7d41-4da9-ab3e-291090481f9a service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.749264 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186addf-7d41-4da9-ab3e-291090481f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.749539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186addf-7d41-4da9-ab3e-291090481f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.751587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e186addf-7d41-4da9-ab3e-291090481f9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:55.799929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1032/2060] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:55.809411 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3fbd0-ae6d-47e9-b4e0-36c74549f4c9 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:55.815561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186addf-7d41-4da9-ab3e-291090481f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.817011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186addf-7d41-4da9-ab3e-291090481f9a service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.818564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3fbd0-ae6d-47e9-b4e0-36c74549f4c9 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:55.822108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e7e33-06fc-4289-9f82-c940c276f8c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:55.822785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e7e33-06fc-4289-9f82-c940c276f8c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:55.823066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e7e33-06fc-4289-9f82-c940c276f8c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:55.823339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e7e33-06fc-4289-9f82-c940c276f8c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:55.826308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1029/2061] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:55.832104 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e7e33-06fc-4289-9f82-c940c276f8c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:55.833677 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e7e33-06fc-4289-9f82-c940c276f8c9 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:55.843134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1033/2062] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:38:56.254584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186addf-7d41-4da9-ab3e-291090481f9a service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:56.256693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e186addf-7d41-4da9-ab3e-291090481f9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:56.338447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186addf-7d41-4da9-ab3e-291090481f9a service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:56.343087 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:56.343955 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:56.344247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:56.344521 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] PATH_INFO: `/v3/users/56babdbf5088443585cf9841b1f49350` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:56.345745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56babdbf5088443585cf9841b1f49350)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:56.347699 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:56.397608 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56babdbf5088443585cf9841b1f49350'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:56.404964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56babdbf5088443585cf9841b1f49350'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:56.417231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56babdbf5088443585cf9841b1f49350'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:56.417927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56babdbf5088443585cf9841b1f49350'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:56.418627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56babdbf5088443585cf9841b1f49350'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:56.434038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1030/2063] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:56 2022] DELETE /identity/v3/users/56babdbf5088443585cf9841b1f49350 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:56.438519 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3b316-a0dd-4cb7-9ee4-85488c080f70 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:56.438910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3b316-a0dd-4cb7-9ee4-85488c080f70 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:56.439083 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3b316-a0dd-4cb7-9ee4-85488c080f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:56.457481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-f0a3b316-a0dd-4cb7-9ee4-85488c080f70 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:56.458712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f0a3b316-a0dd-4cb7-9ee4-85488c080f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:56.528768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1034/2064] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:56.539160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:56.540631 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:56.597927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc7c17-e7ab-4489-b2a3-5367fb438549 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:56.601607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad27fc-e5a8-43ed-a855-aa1f6802c839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:56.602276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad27fc-e5a8-43ed-a855-aa1f6802c839 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:56.602561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad27fc-e5a8-43ed-a855-aa1f6802c839 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:56.602840 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad27fc-e5a8-43ed-a855-aa1f6802c839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:56.612319 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad27fc-e5a8-43ed-a855-aa1f6802c839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:56.613750 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad27fc-e5a8-43ed-a855-aa1f6802c839 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:56.625797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1031/2065] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:56.899006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3b316-a0dd-4cb7-9ee4-85488c080f70 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:56.900425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f0a3b316-a0dd-4cb7-9ee4-85488c080f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:56.913234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3b316-a0dd-4cb7-9ee4-85488c080f70 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:56.918922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:56.919806 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:56.920064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:56.920337 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] PATH_INFO: `/v3/projects/f959c2e7ebf44e5e819d620da2f346d3` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:56.921514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f959c2e7ebf44e5e819d620da2f346d3)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:56.923444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:56.969639 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f959c2e7ebf44e5e819d620da2f346d3', 'request_id': 'req-917b8fbd-f2de-4f0d-ad5d-160495893990'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:56.975356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f959c2e7ebf44e5e819d620da2f346d3', 'request_id': 'req-917b8fbd-f2de-4f0d-ad5d-160495893990'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:56.982849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f959c2e7ebf44e5e819d620da2f346d3', 'request_id': 'req-917b8fbd-f2de-4f0d-ad5d-160495893990'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:56.994459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] The token cache is being invalidate because project f959c2e7ebf44e5e819d620da2f346d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:56.994753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:56.995753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:56.996917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1035/2066] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:56 2022] DELETE /identity/v3/projects/f959c2e7ebf44e5e819d620da2f346d3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:57.000805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad27fc-e5a8-43ed-a855-aa1f6802c839 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:57.010640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad27fc-e5a8-43ed-a855-aa1f6802c839 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:57.066220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831d5f9-5138-44c4-9150-b8248e3da7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:57.067093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831d5f9-5138-44c4-9150-b8248e3da7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:57.067369 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831d5f9-5138-44c4-9150-b8248e3da7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:57.067649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831d5f9-5138-44c4-9150-b8248e3da7ac admin admin] PATH_INFO: `/v3/users/a9748b933886492e957a600a8d11f4ea` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:57.068880 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831d5f9-5138-44c4-9150-b8248e3da7ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9748b933886492e957a600a8d11f4ea)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:57.070817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831d5f9-5138-44c4-9150-b8248e3da7ac admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:57.124740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-7831d5f9-5138-44c4-9150-b8248e3da7ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9748b933886492e957a600a8d11f4ea'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:57.131517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-7831d5f9-5138-44c4-9150-b8248e3da7ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9748b933886492e957a600a8d11f4ea'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:57.142752 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-7831d5f9-5138-44c4-9150-b8248e3da7ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9748b933886492e957a600a8d11f4ea'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:57.143416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-7831d5f9-5138-44c4-9150-b8248e3da7ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9748b933886492e957a600a8d11f4ea'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:57.144022 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-7831d5f9-5138-44c4-9150-b8248e3da7ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9748b933886492e957a600a8d11f4ea'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:57.158040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1032/2067] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:56 2022] DELETE /identity/v3/users/a9748b933886492e957a600a8d11f4ea => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:57.468975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:57.470423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:57.486524 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b8fbd-f2de-4f0d-ad5d-160495893990 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:57.581493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:57.582900 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:57.583830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:57.585164 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d admin admin] PATH_INFO: `/v3/projects/cbff087944bc4797acc12b49cfdc4b52` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:57.587032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbff087944bc4797acc12b49cfdc4b52)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:57.589888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:57.675461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbff087944bc4797acc12b49cfdc4b52', 'request_id': 'req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:57.681668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbff087944bc4797acc12b49cfdc4b52', 'request_id': 'req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:57.698507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbff087944bc4797acc12b49cfdc4b52', 'request_id': 'req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:57.713314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d admin admin] The token cache is being invalidate because project cbff087944bc4797acc12b49cfdc4b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:57.713611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:57.714329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99dd47d5-6c28-4fb6-8507-cd887fa67a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:57.720522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1036/2068] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:57 2022] DELETE /identity/v3/projects/cbff087944bc4797acc12b49cfdc4b52 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:57.723007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912e702-d50a-4fec-9461-3507507b4652 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:57.723377 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912e702-d50a-4fec-9461-3507507b4652 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:57.723732 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912e702-d50a-4fec-9461-3507507b4652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:57.743856 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-b912e702-d50a-4fec-9461-3507507b4652 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:57.745282 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b912e702-d50a-4fec-9461-3507507b4652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:57.826964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1033/2069] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:57.835914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b22c1-0ba2-476f-b2dc-0c1e455f3e92 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:57.836201 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b22c1-0ba2-476f-b2dc-0c1e455f3e92 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:57.836479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b22c1-0ba2-476f-b2dc-0c1e455f3e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:57.858686 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-4c5b22c1-0ba2-476f-b2dc-0c1e455f3e92 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:57.860307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-4c5b22c1-0ba2-476f-b2dc-0c1e455f3e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:57.879883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1037/2070] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:57.884638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912e702-d50a-4fec-9461-3507507b4652 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:57.895561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912e702-d50a-4fec-9461-3507507b4652 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:57.907618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27c15a-7caa-4672-9fae-876b40a1ee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:57.908293 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27c15a-7caa-4672-9fae-876b40a1ee74 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:57.908579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27c15a-7caa-4672-9fae-876b40a1ee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:57.908849 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27c15a-7caa-4672-9fae-876b40a1ee74 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:57.909708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27c15a-7caa-4672-9fae-876b40a1ee74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:57.909903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27c15a-7caa-4672-9fae-876b40a1ee74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:57.911549 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27c15a-7caa-4672-9fae-876b40a1ee74 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:57.924443 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1034/2071] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:57.937480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b22c1-0ba2-476f-b2dc-0c1e455f3e92 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:57.948277 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b22c1-0ba2-476f-b2dc-0c1e455f3e92 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:57.953518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f1473-cc84-4659-bdf1-1463495c26b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:57.954353 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f1473-cc84-4659-bdf1-1463495c26b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:57.954854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f1473-cc84-4659-bdf1-1463495c26b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:57.955206 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f1473-cc84-4659-bdf1-1463495c26b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:57.956017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f1473-cc84-4659-bdf1-1463495c26b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:57.957976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f1473-cc84-4659-bdf1-1463495c26b8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:57.993766 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1038/2072] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:57 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:57.998259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27c15a-7caa-4672-9fae-876b40a1ee74 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:58.012348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27c15a-7caa-4672-9fae-876b40a1ee74 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:58.101867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33ec33-5cda-429b-b6ab-e91f19d08714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:58.103134 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33ec33-5cda-429b-b6ab-e91f19d08714 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:58.103653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33ec33-5cda-429b-b6ab-e91f19d08714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:58.104162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33ec33-5cda-429b-b6ab-e91f19d08714 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:58.104976 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33ec33-5cda-429b-b6ab-e91f19d08714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:58.107921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33ec33-5cda-429b-b6ab-e91f19d08714 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:58.135406 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1035/2073] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:57 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:38:58.142447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f1473-cc84-4659-bdf1-1463495c26b8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:58.153714 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f1473-cc84-4659-bdf1-1463495c26b8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:58.159738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedefcb-fb5b-4442-8fd4-aef22c1fed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:58.160347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedefcb-fb5b-4442-8fd4-aef22c1fed95 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:58.160632 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedefcb-fb5b-4442-8fd4-aef22c1fed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:58.161035 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedefcb-fb5b-4442-8fd4-aef22c1fed95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:58.161773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedefcb-fb5b-4442-8fd4-aef22c1fed95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:58.163993 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedefcb-fb5b-4442-8fd4-aef22c1fed95 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:58.175384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1039/2074] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:58.179483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33ec33-5cda-429b-b6ab-e91f19d08714 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:58.191424 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33ec33-5cda-429b-b6ab-e91f19d08714 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:58.197236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b379a5a-38bc-4841-9a0d-08a0e24689a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:58.197971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b379a5a-38bc-4841-9a0d-08a0e24689a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:58.198310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b379a5a-38bc-4841-9a0d-08a0e24689a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:58.198590 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b379a5a-38bc-4841-9a0d-08a0e24689a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:58.199415 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b379a5a-38bc-4841-9a0d-08a0e24689a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:58.201073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b379a5a-38bc-4841-9a0d-08a0e24689a8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:58.215113 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1036/2075] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:38:58.216557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedefcb-fb5b-4442-8fd4-aef22c1fed95 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:58.227930 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedefcb-fb5b-4442-8fd4-aef22c1fed95 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:58.233105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457b441-d770-414e-be1f-f646472aa548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:58.234104 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457b441-d770-414e-be1f-f646472aa548 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:58.234472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457b441-d770-414e-be1f-f646472aa548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:58.234812 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457b441-d770-414e-be1f-f646472aa548 admin admin] PATH_INFO: `/v3/projects/45d059836e7e40dfa037b57255574224/users/a4784e35a6dc490483b63691c537ebb3/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:58.251372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457b441-d770-414e-be1f-f646472aa548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d059836e7e40dfa037b57255574224, user_id=a4784e35a6dc490483b63691c537ebb3, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:58.254531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457b441-d770-414e-be1f-f646472aa548 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:58.269325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1040/2076] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:58 2022] PUT /identity/v3/projects/45d059836e7e40dfa037b57255574224/users/a4784e35a6dc490483b63691c537ebb3/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:58.280667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d9de-6547-49ba-951c-8a4edee8d83f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:58.281092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d9de-6547-49ba-951c-8a4edee8d83f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:58.281269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d9de-6547-49ba-951c-8a4edee8d83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:58.309294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0765d9de-6547-49ba-951c-8a4edee8d83f None None] MFA Rules not processed for user `a4784e35a6dc490483b63691c537ebb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:58.310581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0765d9de-6547-49ba-951c-8a4edee8d83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:58.388345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1037/2077] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:58.398892 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457b441-d770-414e-be1f-f646472aa548 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:58.400562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9457b441-d770-414e-be1f-f646472aa548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:58.456187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457b441-d770-414e-be1f-f646472aa548 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:58.460159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb14721-d408-4647-a5cb-09d31918f321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:58.460797 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb14721-d408-4647-a5cb-09d31918f321 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:58.461082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb14721-d408-4647-a5cb-09d31918f321 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:58.461356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb14721-d408-4647-a5cb-09d31918f321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:58.469496 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb14721-d408-4647-a5cb-09d31918f321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:58.471606 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb14721-d408-4647-a5cb-09d31918f321 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:58.481014 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1041/2078] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:58.501327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765d9de-6547-49ba-951c-8a4edee8d83f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:58.562425 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765d9de-6547-49ba-951c-8a4edee8d83f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:58.566959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:58.567814 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:58.568092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:58.568364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] PATH_INFO: `/v3/users/a4784e35a6dc490483b63691c537ebb3` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:58.569569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4784e35a6dc490483b63691c537ebb3)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:58.571571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:58.623177 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4784e35a6dc490483b63691c537ebb3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:58.629910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4784e35a6dc490483b63691c537ebb3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:58.641927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4784e35a6dc490483b63691c537ebb3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:58.642689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4784e35a6dc490483b63691c537ebb3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:58.643306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4784e35a6dc490483b63691c537ebb3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:58.658244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1038/2079] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:58 2022] DELETE /identity/v3/users/a4784e35a6dc490483b63691c537ebb3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:58.663526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e4235-912d-418b-8f9a-b3281e523655 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:58.663817 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e4235-912d-418b-8f9a-b3281e523655 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:58.664095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e4235-912d-418b-8f9a-b3281e523655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:58.681489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-1a3e4235-912d-418b-8f9a-b3281e523655 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:58.682718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1a3e4235-912d-418b-8f9a-b3281e523655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:58.747551 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1042/2080] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:58.757694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:58.759288 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:58.822803 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fac18-d42d-4329-abc5-98ba3a164b93 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:58.826528 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cace1-c8b2-404f-8765-446f9780fc7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:58.827175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cace1-c8b2-404f-8765-446f9780fc7b service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:58.827448 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cace1-c8b2-404f-8765-446f9780fc7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:58.827718 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cace1-c8b2-404f-8765-446f9780fc7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:58.837602 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cace1-c8b2-404f-8765-446f9780fc7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:58.839075 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cace1-c8b2-404f-8765-446f9780fc7b service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:58.848136 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1039/2081] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:38:59.204563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e4235-912d-418b-8f9a-b3281e523655 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:59.207227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1a3e4235-912d-418b-8f9a-b3281e523655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:59.232689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e4235-912d-418b-8f9a-b3281e523655 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:59.242163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:59.243838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.247156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.247462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975 admin admin] PATH_INFO: `/v3/projects/45d059836e7e40dfa037b57255574224` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.259071 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d059836e7e40dfa037b57255574224)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:59.261021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:59.348347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cace1-c8b2-404f-8765-446f9780fc7b service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:59.349871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2d3cace1-c8b2-404f-8765-446f9780fc7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:59.366522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d059836e7e40dfa037b57255574224', 'request_id': 'req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.372517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cace1-c8b2-404f-8765-446f9780fc7b service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:59.376368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d059836e7e40dfa037b57255574224', 'request_id': 'req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.386724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d059836e7e40dfa037b57255574224', 'request_id': 'req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.400047 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975 admin admin] The token cache is being invalidate because project 45d059836e7e40dfa037b57255574224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:59.400443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.401291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-21ecaeb9-6fa3-4c53-9b91-5f0f7943f975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.403509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1043/2082] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:59 2022] DELETE /identity/v3/projects/45d059836e7e40dfa037b57255574224 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:59.408895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa35f-8560-4bd4-8102-e74ebdeb2731 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.409517 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa35f-8560-4bd4-8102-e74ebdeb2731 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.409996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa35f-8560-4bd4-8102-e74ebdeb2731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.435172 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-d9cfa35f-8560-4bd4-8102-e74ebdeb2731 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:59.436808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-d9cfa35f-8560-4bd4-8102-e74ebdeb2731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:59.438151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f34fd-6e4b-4dee-acf2-c8d3cdffb2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:59.439052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f34fd-6e4b-4dee-acf2-c8d3cdffb2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.439327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f34fd-6e4b-4dee-acf2-c8d3cdffb2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.439596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f34fd-6e4b-4dee-acf2-c8d3cdffb2e9 admin admin] PATH_INFO: `/v3/users/256859ab4bdb40479df9930501987edf` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.440870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f34fd-6e4b-4dee-acf2-c8d3cdffb2e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=256859ab4bdb40479df9930501987edf)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:59.443433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f34fd-6e4b-4dee-acf2-c8d3cdffb2e9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:59.448134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1044/2083] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:59.457024 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5661e0c-542e-4750-861b-24550e03a226 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.457308 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5661e0c-542e-4750-861b-24550e03a226 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.457779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5661e0c-542e-4750-861b-24550e03a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.476989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c5661e0c-542e-4750-861b-24550e03a226 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:59.478240 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c5661e0c-542e-4750-861b-24550e03a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:59.492232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1045/2084] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:59.493810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5661e0c-542e-4750-861b-24550e03a226 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:59.505405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5661e0c-542e-4750-861b-24550e03a226 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:59.511747 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fc185-a578-482b-892f-173deb992641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:59.512369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fc185-a578-482b-892f-173deb992641 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.512657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fc185-a578-482b-892f-173deb992641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.512932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fc185-a578-482b-892f-173deb992641 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.513902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fc185-a578-482b-892f-173deb992641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:59.514036 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fc185-a578-482b-892f-173deb992641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:59.516061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fc185-a578-482b-892f-173deb992641 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:59.520741 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8f6f34fd-6e4b-4dee-acf2-c8d3cdffb2e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256859ab4bdb40479df9930501987edf'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.528876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8f6f34fd-6e4b-4dee-acf2-c8d3cdffb2e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256859ab4bdb40479df9930501987edf'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.533734 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1046/2085] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:59.539216 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fc185-a578-482b-892f-173deb992641 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:59.542614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8f6f34fd-6e4b-4dee-acf2-c8d3cdffb2e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256859ab4bdb40479df9930501987edf'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.543441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8f6f34fd-6e4b-4dee-acf2-c8d3cdffb2e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256859ab4bdb40479df9930501987edf'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.544221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8f6f34fd-6e4b-4dee-acf2-c8d3cdffb2e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256859ab4bdb40479df9930501987edf'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.553250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fc185-a578-482b-892f-173deb992641 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:59.559202 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4bb30-9090-450a-ae76-4889aa6bd97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:59.560881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4bb30-9090-450a-ae76-4889aa6bd97e admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.561223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4bb30-9090-450a-ae76-4889aa6bd97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.561565 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4bb30-9090-450a-ae76-4889aa6bd97e admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.562881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4bb30-9090-450a-ae76-4889aa6bd97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:59.565209 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4bb30-9090-450a-ae76-4889aa6bd97e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:59.572231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1040/2086] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:59 2022] DELETE /identity/v3/users/256859ab4bdb40479df9930501987edf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:59.574162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4fa27-46bb-4393-8c78-147cfe31558a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.574647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4fa27-46bb-4393-8c78-147cfe31558a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.575234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4fa27-46bb-4393-8c78-147cfe31558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.594951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4da4fa27-46bb-4393-8c78-147cfe31558a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:59.596289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4da4fa27-46bb-4393-8c78-147cfe31558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:59.597576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1047/2087] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:59 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:59.601662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4bb30-9090-450a-ae76-4889aa6bd97e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:59.603508 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-32d4bb30-9090-450a-ae76-4889aa6bd97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:59.661518 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1041/2088] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:38:59.662893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4fa27-46bb-4393-8c78-147cfe31558a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:59.664121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4da4fa27-46bb-4393-8c78-147cfe31558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:59.673114 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4bb30-9090-450a-ae76-4889aa6bd97e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:59.675461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4fa27-46bb-4393-8c78-147cfe31558a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:59.677802 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcb552-ea9c-4a0a-95f7-672ee1c4cbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:59.679019 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcb552-ea9c-4a0a-95f7-672ee1c4cbfd admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.679300 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcb552-ea9c-4a0a-95f7-672ee1c4cbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.679572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcb552-ea9c-4a0a-95f7-672ee1c4cbfd admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.680294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcb552-ea9c-4a0a-95f7-672ee1c4cbfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:59.680724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:59.681587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.681871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.682148 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] PATH_INFO: `/v3/users/08bcf5a89af94826b4b4ae3510b5de2b` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.682288 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcb552-ea9c-4a0a-95f7-672ee1c4cbfd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:59.683378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08bcf5a89af94826b4b4ae3510b5de2b)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:59.685274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:59.706684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1048/2089] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:59 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:38:59.706684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcb552-ea9c-4a0a-95f7-672ee1c4cbfd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:59.706684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-87dcb552-ea9c-4a0a-95f7-672ee1c4cbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:59.729842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08bcf5a89af94826b4b4ae3510b5de2b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.736344 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08bcf5a89af94826b4b4ae3510b5de2b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.748237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08bcf5a89af94826b4b4ae3510b5de2b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.748865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08bcf5a89af94826b4b4ae3510b5de2b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.749491 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08bcf5a89af94826b4b4ae3510b5de2b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:59.761974 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1042/2090] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:59 2022] DELETE /identity/v3/users/08bcf5a89af94826b4b4ae3510b5de2b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:59.762819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:59.763983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcb552-ea9c-4a0a-95f7-672ee1c4cbfd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:59.764153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:59.815898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905c252-b0e4-4010-8405-2c0dc929681e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:59.816822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905c252-b0e4-4010-8405-2c0dc929681e service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.817159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905c252-b0e4-4010-8405-2c0dc929681e service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.817439 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905c252-b0e4-4010-8405-2c0dc929681e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.819650 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7905c252-b0e4-4010-8405-2c0dc929681e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:59.825280 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5637ae0-a449-46da-a4f8-9ef98f63e449 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:59.829891 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6b4be-b5f8-479a-b76b-f32bed1b5c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:59.830583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6b4be-b5f8-479a-b76b-f32bed1b5c71 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.830866 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6b4be-b5f8-479a-b76b-f32bed1b5c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.831140 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6b4be-b5f8-479a-b76b-f32bed1b5c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.831870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6b4be-b5f8-479a-b76b-f32bed1b5c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:59.832012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905c252-b0e4-4010-8405-2c0dc929681e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:59.833596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6b4be-b5f8-479a-b76b-f32bed1b5c71 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:59.833684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905c252-b0e4-4010-8405-2c0dc929681e service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:59.843399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1043/2091] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:59.844619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb0760-5ba3-4267-a694-31662f6c587c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.844907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb0760-5ba3-4267-a694-31662f6c587c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.845185 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb0760-5ba3-4267-a694-31662f6c587c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.848584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1049/2092] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:59.849386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905c252-b0e4-4010-8405-2c0dc929681e service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:59.863665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-d2fb0760-5ba3-4267-a694-31662f6c587c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:59.864805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905c252-b0e4-4010-8405-2c0dc929681e service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:59.864941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d2fb0760-5ba3-4267-a694-31662f6c587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:59.870497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e736-5c81-4c40-85b6-5defb6728312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:59.871252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e736-5c81-4c40-85b6-5defb6728312 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.871643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e736-5c81-4c40-85b6-5defb6728312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.871931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e736-5c81-4c40-85b6-5defb6728312 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.872873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e736-5c81-4c40-85b6-5defb6728312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:59.873349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1044/2093] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:59.874822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e736-5c81-4c40-85b6-5defb6728312 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:59.883455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb0760-5ba3-4267-a694-31662f6c587c None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:59.885068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d2fb0760-5ba3-4267-a694-31662f6c587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:59.885757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1050/2094] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:59.889701 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e736-5c81-4c40-85b6-5defb6728312 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:59.897874 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb0760-5ba3-4267-a694-31662f6c587c None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:59.899674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e736-5c81-4c40-85b6-5defb6728312 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:59.902479 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74160074-2d12-4f2b-b404-7159e6931479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:59.903156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74160074-2d12-4f2b-b404-7159e6931479 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.903761 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74160074-2d12-4f2b-b404-7159e6931479 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.903761 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74160074-2d12-4f2b-b404-7159e6931479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.905747 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654dfb7-5c4d-4b07-b4ef-8b49aee7ca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:59.906859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654dfb7-5c4d-4b07-b4ef-8b49aee7ca0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.907216 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654dfb7-5c4d-4b07-b4ef-8b49aee7ca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.907551 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654dfb7-5c4d-4b07-b4ef-8b49aee7ca0a admin admin] PATH_INFO: `/v3/projects/2c6378a3978d441d8289a4ca48c3827e/users/f82ae2fa9f3340d6870468b94ac79bba/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.915886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74160074-2d12-4f2b-b404-7159e6931479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:59.917463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74160074-2d12-4f2b-b404-7159e6931479 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:59.925144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654dfb7-5c4d-4b07-b4ef-8b49aee7ca0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6378a3978d441d8289a4ca48c3827e, user_id=f82ae2fa9f3340d6870468b94ac79bba, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:59.928821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654dfb7-5c4d-4b07-b4ef-8b49aee7ca0a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:59.929376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1045/2095] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:38:59.942833 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1051/2096] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:59 2022] PUT /identity/v3/projects/2c6378a3978d441d8289a4ca48c3827e/users/f82ae2fa9f3340d6870468b94ac79bba/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:59.953931 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f253ade-7431-4daf-92a8-8f9f59e554ae None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:59.954251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f253ade-7431-4daf-92a8-8f9f59e554ae None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:59.954530 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f253ade-7431-4daf-92a8-8f9f59e554ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:59.985889 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2f253ade-7431-4daf-92a8-8f9f59e554ae None None] MFA Rules not processed for user `f82ae2fa9f3340d6870468b94ac79bba`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:59.987498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2f253ade-7431-4daf-92a8-8f9f59e554ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:00.113951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1046/2097] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:00.130416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654dfb7-5c4d-4b07-b4ef-8b49aee7ca0a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:00.132751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1654dfb7-5c4d-4b07-b4ef-8b49aee7ca0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:00.197107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f253ade-7431-4daf-92a8-8f9f59e554ae None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:00.199639 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2f253ade-7431-4daf-92a8-8f9f59e554ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:00.240914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654dfb7-5c4d-4b07-b4ef-8b49aee7ca0a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:00.252464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54b482-4214-4807-aac6-23809390c1f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68b3bc64dc94865a72cea0988fa9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:00.253491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54b482-4214-4807-aac6-23809390c1f8 service glance] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:00.254898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54b482-4214-4807-aac6-23809390c1f8 service glance] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:00.255311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54b482-4214-4807-aac6-23809390c1f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:00.279027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54b482-4214-4807-aac6-23809390c1f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:00.282907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54b482-4214-4807-aac6-23809390c1f8 service glance] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:00.310462 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f253ade-7431-4daf-92a8-8f9f59e554ae None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:00.312531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1052/2098] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:00.322499 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e9a86-2fc8-451c-a013-4db65303cbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:00.323466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e9a86-2fc8-451c-a013-4db65303cbe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:00.323730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e9a86-2fc8-451c-a013-4db65303cbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:00.324006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e9a86-2fc8-451c-a013-4db65303cbe9 admin admin] PATH_INFO: `/v3/projects/051960a04338446b9e1c8795ea5403ca` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:00.325329 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e9a86-2fc8-451c-a013-4db65303cbe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051960a04338446b9e1c8795ea5403ca)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:00.328057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e9a86-2fc8-451c-a013-4db65303cbe9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:00.377569 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54b482-4214-4807-aac6-23809390c1f8 service glance] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:00.379061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fe54b482-4214-4807-aac6-23809390c1f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:00.404393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54b482-4214-4807-aac6-23809390c1f8 service glance] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:00.429554 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c15e9a86-2fc8-451c-a013-4db65303cbe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051960a04338446b9e1c8795ea5403ca', 'request_id': 'req-c15e9a86-2fc8-451c-a013-4db65303cbe9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.443425 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c15e9a86-2fc8-451c-a013-4db65303cbe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051960a04338446b9e1c8795ea5403ca', 'request_id': 'req-c15e9a86-2fc8-451c-a013-4db65303cbe9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.479086 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c15e9a86-2fc8-451c-a013-4db65303cbe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051960a04338446b9e1c8795ea5403ca', 'request_id': 'req-c15e9a86-2fc8-451c-a013-4db65303cbe9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.494069 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:00.495203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:00.495707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:00.496157 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] PATH_INFO: `/v3/projects/c52e1975d28c42db97d338c25157f7c5` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:00.497866 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52e1975d28c42db97d338c25157f7c5)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:00.500958 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:00.510003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c15e9a86-2fc8-451c-a013-4db65303cbe9 admin admin] The token cache is being invalidate because project 051960a04338446b9e1c8795ea5403ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:00.510534 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c15e9a86-2fc8-451c-a013-4db65303cbe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.511344 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c15e9a86-2fc8-451c-a013-4db65303cbe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.513115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1047/2099] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:00 2022] DELETE /identity/v3/projects/051960a04338446b9e1c8795ea5403ca => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:00.518631 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67e78-39c7-4975-bd1e-4bfcf15484a0 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:00.519084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67e78-39c7-4975-bd1e-4bfcf15484a0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:00.519644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67e78-39c7-4975-bd1e-4bfcf15484a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:00.565859 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0da67e78-39c7-4975-bd1e-4bfcf15484a0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:00.567093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0da67e78-39c7-4975-bd1e-4bfcf15484a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:00.567237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52e1975d28c42db97d338c25157f7c5', 'request_id': 'req-975237fa-d857-46c1-885e-59b67c461571'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.583194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52e1975d28c42db97d338c25157f7c5', 'request_id': 'req-975237fa-d857-46c1-885e-59b67c461571'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.602318 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52e1975d28c42db97d338c25157f7c5', 'request_id': 'req-975237fa-d857-46c1-885e-59b67c461571'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.625315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] The token cache is being invalidate because project c52e1975d28c42db97d338c25157f7c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:00.625550 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.626102 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.627974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1053/2100] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:00 2022] DELETE /identity/v3/projects/c52e1975d28c42db97d338c25157f7c5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:00.631998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:00.633391 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:00.634870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1048/2101] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:00.642551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a6a97-6df1-41fe-b805-65335037a1e8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:00.642842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a6a97-6df1-41fe-b805-65335037a1e8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:00.643170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a6a97-6df1-41fe-b805-65335037a1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:00.655363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975237fa-d857-46c1-885e-59b67c461571 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:00.662696 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:00.664010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:00.665206 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:00.665697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] PATH_INFO: `/v3/users/b9ccdf53023945de8cb02fc202e2f32a` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:00.667297 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ccdf53023945de8cb02fc202e2f32a)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:00.670154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:00.671062 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-be4a6a97-6df1-41fe-b805-65335037a1e8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:00.672267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-be4a6a97-6df1-41fe-b805-65335037a1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:00.681345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1049/2102] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:00.685287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a6a97-6df1-41fe-b805-65335037a1e8 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:00.694569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a6a97-6df1-41fe-b805-65335037a1e8 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:00.702637 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a0333-47fb-47ea-8626-1be95eb142e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:00.703341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0333-47fb-47ea-8626-1be95eb142e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:00.703623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0333-47fb-47ea-8626-1be95eb142e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:00.704006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0333-47fb-47ea-8626-1be95eb142e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:00.704921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a0333-47fb-47ea-8626-1be95eb142e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:39:00.705248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a0333-47fb-47ea-8626-1be95eb142e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:00.707317 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a0333-47fb-47ea-8626-1be95eb142e6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:00.727001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1050/2103] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:39:00.728552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a0333-47fb-47ea-8626-1be95eb142e6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:00.738618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a0333-47fb-47ea-8626-1be95eb142e6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:00.744666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3038b0-d342-4285-a516-25b33d97be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:00.745096 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3038b0-d342-4285-a516-25b33d97be57 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:00.745375 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3038b0-d342-4285-a516-25b33d97be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:00.745645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3038b0-d342-4285-a516-25b33d97be57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:00.746376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3038b0-d342-4285-a516-25b33d97be57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:00.748277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3038b0-d342-4285-a516-25b33d97be57 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:00.757935 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ccdf53023945de8cb02fc202e2f32a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.768337 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ccdf53023945de8cb02fc202e2f32a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.776322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1051/2104] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:00 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:00.780309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3038b0-d342-4285-a516-25b33d97be57 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:00.788661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ccdf53023945de8cb02fc202e2f32a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.789664 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ccdf53023945de8cb02fc202e2f32a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.798922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ccdf53023945de8cb02fc202e2f32a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:00.813108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1054/2105] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:00 2022] DELETE /identity/v3/users/b9ccdf53023945de8cb02fc202e2f32a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:00.893814 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3038b0-d342-4285-a516-25b33d97be57 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:00.986550 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7589e8-78f3-4730-bbd9-9bb4825ebc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:00.987223 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7589e8-78f3-4730-bbd9-9bb4825ebc9b admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:00.987519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7589e8-78f3-4730-bbd9-9bb4825ebc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:00.987847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7589e8-78f3-4730-bbd9-9bb4825ebc9b admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:00.988543 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7589e8-78f3-4730-bbd9-9bb4825ebc9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:00.990556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7589e8-78f3-4730-bbd9-9bb4825ebc9b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:01.016697 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1052/2106] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:00 2022] POST /identity/v3/users => generated 284 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:01.020655 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:01.023329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:01.036066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51ab6e-d367-4891-a899-6c18feddec92 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:01.041260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d193825-aa41-486d-9b19-f45b221e95b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:01.041921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d193825-aa41-486d-9b19-f45b221e95b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.042219 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d193825-aa41-486d-9b19-f45b221e95b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.042507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d193825-aa41-486d-9b19-f45b221e95b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.043358 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d193825-aa41-486d-9b19-f45b221e95b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:01.044959 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d193825-aa41-486d-9b19-f45b221e95b3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:01.055232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1055/2107] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:39:01.059383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7589e8-78f3-4730-bbd9-9bb4825ebc9b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:01.069308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7589e8-78f3-4730-bbd9-9bb4825ebc9b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:01.074640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf45feb-2caa-4802-9ff3-8b368ab3ed2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:01.074996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf45feb-2caa-4802-9ff3-8b368ab3ed2a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.075274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf45feb-2caa-4802-9ff3-8b368ab3ed2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.075544 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf45feb-2caa-4802-9ff3-8b368ab3ed2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.076266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf45feb-2caa-4802-9ff3-8b368ab3ed2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:01.077850 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf45feb-2caa-4802-9ff3-8b368ab3ed2a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:01.093463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1053/2108] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:01.093666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d193825-aa41-486d-9b19-f45b221e95b3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:01.109329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d193825-aa41-486d-9b19-f45b221e95b3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:01.113914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8688bc-25ca-4791-a4dd-0abed49f6dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:01.114832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8688bc-25ca-4791-a4dd-0abed49f6dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.115165 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8688bc-25ca-4791-a4dd-0abed49f6dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.115441 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8688bc-25ca-4791-a4dd-0abed49f6dd5 admin admin] PATH_INFO: `/v3/projects/d2b4c47b6b6044c582fed3a84357e02e/users/510b1c21176644c6b4ee2f30429eb2aa/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.131013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8688bc-25ca-4791-a4dd-0abed49f6dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b4c47b6b6044c582fed3a84357e02e, user_id=510b1c21176644c6b4ee2f30429eb2aa, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:01.134433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8688bc-25ca-4791-a4dd-0abed49f6dd5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:01.150477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1056/2109] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:01 2022] PUT /identity/v3/projects/d2b4c47b6b6044c582fed3a84357e02e/users/510b1c21176644c6b4ee2f30429eb2aa/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:01.153019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf45feb-2caa-4802-9ff3-8b368ab3ed2a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:01.155394 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ecf45feb-2caa-4802-9ff3-8b368ab3ed2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:01.158867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90d83a-ad14-4c7b-b2a9-93d429ca4305 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.159267 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90d83a-ad14-4c7b-b2a9-93d429ca4305 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.159548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90d83a-ad14-4c7b-b2a9-93d429ca4305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.186777 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf45feb-2caa-4802-9ff3-8b368ab3ed2a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:01.189751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-4b90d83a-ad14-4c7b-b2a9-93d429ca4305 None None] MFA Rules not processed for user `510b1c21176644c6b4ee2f30429eb2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:01.191092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-4b90d83a-ad14-4c7b-b2a9-93d429ca4305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:01.244596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c3b47-fa2f-417c-b0d4-10215e31c6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:01.245458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c3b47-fa2f-417c-b0d4-10215e31c6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.245735 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c3b47-fa2f-417c-b0d4-10215e31c6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.246011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c3b47-fa2f-417c-b0d4-10215e31c6cf admin admin] PATH_INFO: `/v3/projects/1da7ecfcb7f34d30b2a17cd86e362a8f` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.247365 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c3b47-fa2f-417c-b0d4-10215e31c6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da7ecfcb7f34d30b2a17cd86e362a8f)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:01.249289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c3b47-fa2f-417c-b0d4-10215e31c6cf admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:01.260251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1057/2110] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:01.272911 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90d83a-ad14-4c7b-b2a9-93d429ca4305 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:01.274278 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-4b90d83a-ad14-4c7b-b2a9-93d429ca4305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:01.305536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-051c3b47-fa2f-417c-b0d4-10215e31c6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da7ecfcb7f34d30b2a17cd86e362a8f', 'request_id': 'req-051c3b47-fa2f-417c-b0d4-10215e31c6cf'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:01.311816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-051c3b47-fa2f-417c-b0d4-10215e31c6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da7ecfcb7f34d30b2a17cd86e362a8f', 'request_id': 'req-051c3b47-fa2f-417c-b0d4-10215e31c6cf'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:01.320277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-051c3b47-fa2f-417c-b0d4-10215e31c6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da7ecfcb7f34d30b2a17cd86e362a8f', 'request_id': 'req-051c3b47-fa2f-417c-b0d4-10215e31c6cf'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:01.332617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-051c3b47-fa2f-417c-b0d4-10215e31c6cf admin admin] The token cache is being invalidate because project 1da7ecfcb7f34d30b2a17cd86e362a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:01.332936 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-051c3b47-fa2f-417c-b0d4-10215e31c6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:01.333642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-051c3b47-fa2f-417c-b0d4-10215e31c6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:01.335854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90d83a-ad14-4c7b-b2a9-93d429ca4305 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:01.336296 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1054/2111] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:01 2022] DELETE /identity/v3/projects/1da7ecfcb7f34d30b2a17cd86e362a8f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:01.340693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c07fdc-2fc9-4474-ac98-caa4a60f002d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.340980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c07fdc-2fc9-4474-ac98-caa4a60f002d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.341257 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c07fdc-2fc9-4474-ac98-caa4a60f002d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.361169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-09c07fdc-2fc9-4474-ac98-caa4a60f002d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:01.362458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-09c07fdc-2fc9-4474-ac98-caa4a60f002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:01.406791 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf23f1-1aac-45b8-bdf1-33481cb99ec3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68b3bc64dc94865a72cea0988fa9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:01.407613 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf23f1-1aac-45b8-bdf1-33481cb99ec3 service glance] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.407956 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf23f1-1aac-45b8-bdf1-33481cb99ec3 service glance] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.409683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf23f1-1aac-45b8-bdf1-33481cb99ec3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.410341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-aebf23f1-1aac-45b8-bdf1-33481cb99ec3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:01.434883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1055/2112] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:01.434883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b03534-c8d1-4e19-aec1-f9719309f24f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.435557 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b03534-c8d1-4e19-aec1-f9719309f24f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.435557 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b03534-c8d1-4e19-aec1-f9719309f24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.457152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-00b03534-c8d1-4e19-aec1-f9719309f24f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:01.458384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-00b03534-c8d1-4e19-aec1-f9719309f24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:01.466916 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1056/2113] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:01.471272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b03534-c8d1-4e19-aec1-f9719309f24f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:01.482337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b03534-c8d1-4e19-aec1-f9719309f24f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:01.483245 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf23f1-1aac-45b8-bdf1-33481cb99ec3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:01.485414 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf23f1-1aac-45b8-bdf1-33481cb99ec3 service glance] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:01.494537 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2f92-821b-404b-9519-2d99acda992c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:01.497358 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2f92-821b-404b-9519-2d99acda992c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.497358 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2f92-821b-404b-9519-2d99acda992c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.497358 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2f92-821b-404b-9519-2d99acda992c admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.497358 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e2f92-821b-404b-9519-2d99acda992c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:39:01.497358 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e2f92-821b-404b-9519-2d99acda992c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:01.498483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e2f92-821b-404b-9519-2d99acda992c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:01.501171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1058/2114] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:01.514248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1057/2115] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:39:01.516587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf23f1-1aac-45b8-bdf1-33481cb99ec3 service glance] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:01.528748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf23f1-1aac-45b8-bdf1-33481cb99ec3 service glance] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:01.533462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffed10-b9b2-4a75-a319-b17152d1f528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:01.534108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffed10-b9b2-4a75-a319-b17152d1f528 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.534498 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffed10-b9b2-4a75-a319-b17152d1f528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.534897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffed10-b9b2-4a75-a319-b17152d1f528 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.535754 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffed10-b9b2-4a75-a319-b17152d1f528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:01.538363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffed10-b9b2-4a75-a319-b17152d1f528 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:01.579372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1059/2116] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:01 2022] POST /identity/v3/projects => generated 359 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:01.584849 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2f92-821b-404b-9519-2d99acda992c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:01.596843 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2f92-821b-404b-9519-2d99acda992c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:01.655939 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea304d8c-8d0e-4a6e-b0f4-5eb49d056f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:01.656634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea304d8c-8d0e-4a6e-b0f4-5eb49d056f7d admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.656923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea304d8c-8d0e-4a6e-b0f4-5eb49d056f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.657220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea304d8c-8d0e-4a6e-b0f4-5eb49d056f7d admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.658009 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea304d8c-8d0e-4a6e-b0f4-5eb49d056f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:01.660767 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea304d8c-8d0e-4a6e-b0f4-5eb49d056f7d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:01.688155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1058/2117] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:01 2022] POST /identity/v3/users => generated 280 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:01.692107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffed10-b9b2-4a75-a319-b17152d1f528 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:01.703058 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffed10-b9b2-4a75-a319-b17152d1f528 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:01.708713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501979e-0457-4627-944f-c2445df41264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:01.709957 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501979e-0457-4627-944f-c2445df41264 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.710436 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501979e-0457-4627-944f-c2445df41264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.710711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501979e-0457-4627-944f-c2445df41264 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.711442 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501979e-0457-4627-944f-c2445df41264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:01.722662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501979e-0457-4627-944f-c2445df41264 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:01.736662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1060/2118] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:01.740877 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea304d8c-8d0e-4a6e-b0f4-5eb49d056f7d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:01.758731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea304d8c-8d0e-4a6e-b0f4-5eb49d056f7d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:01.766070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6968575-6a7d-4ede-bd49-69d3d4b90f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:01.767303 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6968575-6a7d-4ede-bd49-69d3d4b90f74 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.767525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6968575-6a7d-4ede-bd49-69d3d4b90f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.769020 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6968575-6a7d-4ede-bd49-69d3d4b90f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.770336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6968575-6a7d-4ede-bd49-69d3d4b90f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:01.773467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6968575-6a7d-4ede-bd49-69d3d4b90f74 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:01.790384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1059/2119] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:01.791847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501979e-0457-4627-944f-c2445df41264 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:01.801940 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501979e-0457-4627-944f-c2445df41264 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:01.806871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbed15-7348-4504-827a-c7bd677848cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:01.807752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbed15-7348-4504-827a-c7bd677848cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.808032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbed15-7348-4504-827a-c7bd677848cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.808432 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbed15-7348-4504-827a-c7bd677848cd admin admin] PATH_INFO: `/v3/projects/575879a985d444cda4065d08d6ab69b7/users/bd4986ecce3440b093a58418cd7f5c1f/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.827017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbed15-7348-4504-827a-c7bd677848cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=575879a985d444cda4065d08d6ab69b7, user_id=bd4986ecce3440b093a58418cd7f5c1f, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:01.830990 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbed15-7348-4504-827a-c7bd677848cd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:01.851285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1061/2120] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:01 2022] PUT /identity/v3/projects/575879a985d444cda4065d08d6ab69b7/users/bd4986ecce3440b093a58418cd7f5c1f/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:01.862189 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf0b0-c582-4ce1-a9d5-166925b05168 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:01.862508 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf0b0-c582-4ce1-a9d5-166925b05168 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:01.862795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf0b0-c582-4ce1-a9d5-166925b05168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:01.905023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-9cfaf0b0-c582-4ce1-a9d5-166925b05168 None None] MFA Rules not processed for user `bd4986ecce3440b093a58418cd7f5c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:01.906565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9cfaf0b0-c582-4ce1-a9d5-166925b05168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:01.994110 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1060/2121] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:02.248721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbed15-7348-4504-827a-c7bd677848cd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:02.253197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c7bbed15-7348-4504-827a-c7bd677848cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:02.318280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbed15-7348-4504-827a-c7bd677848cd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:02.322047 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927db8f-722e-4825-9a21-f3a330f551c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:02.322795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927db8f-722e-4825-9a21-f3a330f551c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:02.323080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927db8f-722e-4825-9a21-f3a330f551c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:02.323357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927db8f-722e-4825-9a21-f3a330f551c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:02.332946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927db8f-722e-4825-9a21-f3a330f551c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:02.335253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927db8f-722e-4825-9a21-f3a330f551c2 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:02.344099 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1062/2122] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:02 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:02.359414 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaf0b0-c582-4ce1-a9d5-166925b05168 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:02.422015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaf0b0-c582-4ce1-a9d5-166925b05168 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:02.426965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:02.427852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:02.428132 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:02.428425 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] PATH_INFO: `/v3/users/bd4986ecce3440b093a58418cd7f5c1f` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:02.429578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4986ecce3440b093a58418cd7f5c1f)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:02.431516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:02.478960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4986ecce3440b093a58418cd7f5c1f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:02.485692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4986ecce3440b093a58418cd7f5c1f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:02.499650 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4986ecce3440b093a58418cd7f5c1f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:02.500427 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4986ecce3440b093a58418cd7f5c1f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:02.501093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4986ecce3440b093a58418cd7f5c1f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:02.514134 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1061/2123] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:02 2022] DELETE /identity/v3/users/bd4986ecce3440b093a58418cd7f5c1f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:02.519246 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83fc6-80f3-4c77-b332-ec420e6e12e0 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:02.519540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83fc6-80f3-4c77-b332-ec420e6e12e0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:02.519912 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83fc6-80f3-4c77-b332-ec420e6e12e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:02.538947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c5f83fc6-80f3-4c77-b332-ec420e6e12e0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:02.540121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c5f83fc6-80f3-4c77-b332-ec420e6e12e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:02.608753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1063/2124] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:02.618688 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:02.620070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:02.687451 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6a5d9-6056-4b8a-9525-e12adb2e62b8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:02.691120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c0dab-20c6-457f-8709-d9c9ee65291c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:02.691768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c0dab-20c6-457f-8709-d9c9ee65291c service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:02.692077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c0dab-20c6-457f-8709-d9c9ee65291c service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:02.692477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c0dab-20c6-457f-8709-d9c9ee65291c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:02.702996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c0dab-20c6-457f-8709-d9c9ee65291c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:02.704634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c0dab-20c6-457f-8709-d9c9ee65291c service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:02.715582 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1062/2125] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:03.033997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f83fc6-80f3-4c77-b332-ec420e6e12e0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:03.036901 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c5f83fc6-80f3-4c77-b332-ec420e6e12e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:03.056386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f83fc6-80f3-4c77-b332-ec420e6e12e0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:03.063088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88184ab7-1d22-4e34-b994-a666cdb4248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:03.064223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88184ab7-1d22-4e34-b994-a666cdb4248a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.065450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88184ab7-1d22-4e34-b994-a666cdb4248a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.065987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88184ab7-1d22-4e34-b994-a666cdb4248a admin admin] PATH_INFO: `/v3/projects/575879a985d444cda4065d08d6ab69b7` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.068020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88184ab7-1d22-4e34-b994-a666cdb4248a admin admin] RBAC: Authorizing `identity:delete_project(project_id=575879a985d444cda4065d08d6ab69b7)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:03.072369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88184ab7-1d22-4e34-b994-a666cdb4248a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:03.149461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-88184ab7-1d22-4e34-b994-a666cdb4248a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575879a985d444cda4065d08d6ab69b7', 'request_id': 'req-88184ab7-1d22-4e34-b994-a666cdb4248a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:03.156967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-88184ab7-1d22-4e34-b994-a666cdb4248a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575879a985d444cda4065d08d6ab69b7', 'request_id': 'req-88184ab7-1d22-4e34-b994-a666cdb4248a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:03.164855 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-88184ab7-1d22-4e34-b994-a666cdb4248a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575879a985d444cda4065d08d6ab69b7', 'request_id': 'req-88184ab7-1d22-4e34-b994-a666cdb4248a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:03.182017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-88184ab7-1d22-4e34-b994-a666cdb4248a admin admin] The token cache is being invalidate because project 575879a985d444cda4065d08d6ab69b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:03.182497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-88184ab7-1d22-4e34-b994-a666cdb4248a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:03.183482 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-88184ab7-1d22-4e34-b994-a666cdb4248a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:03.185630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1064/2126] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:03 2022] DELETE /identity/v3/projects/575879a985d444cda4065d08d6ab69b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:03.198241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7ad97-5d31-49b6-b0ec-4d7b6088a72d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.199328 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7ad97-5d31-49b6-b0ec-4d7b6088a72d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.201876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7ad97-5d31-49b6-b0ec-4d7b6088a72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.234719 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-22f7ad97-5d31-49b6-b0ec-4d7b6088a72d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:03.236023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-22f7ad97-5d31-49b6-b0ec-4d7b6088a72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:03.329725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1063/2127] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:03.331931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e07133-b0d0-4cdc-a36d-192a66ca52b0 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.332739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e07133-b0d0-4cdc-a36d-192a66ca52b0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.333091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e07133-b0d0-4cdc-a36d-192a66ca52b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.357109 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-42e07133-b0d0-4cdc-a36d-192a66ca52b0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:03.359598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-42e07133-b0d0-4cdc-a36d-192a66ca52b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:03.374349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1065/2128] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:03.378600 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7ad97-5d31-49b6-b0ec-4d7b6088a72d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:03.390023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7ad97-5d31-49b6-b0ec-4d7b6088a72d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:03.394683 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023d87b-f2ba-44d9-8407-a446bd8775f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:03.395342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023d87b-f2ba-44d9-8407-a446bd8775f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.395632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023d87b-f2ba-44d9-8407-a446bd8775f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.395911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023d87b-f2ba-44d9-8407-a446bd8775f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.396668 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023d87b-f2ba-44d9-8407-a446bd8775f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:39:03.396975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023d87b-f2ba-44d9-8407-a446bd8775f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:03.398603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023d87b-f2ba-44d9-8407-a446bd8775f5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:03.410366 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1064/2129] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:39:03.415079 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e07133-b0d0-4cdc-a36d-192a66ca52b0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:03.423996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e07133-b0d0-4cdc-a36d-192a66ca52b0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:03.429302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85166a-1a77-413a-bc17-af1a33441f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:03.429957 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85166a-1a77-413a-bc17-af1a33441f67 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.430275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85166a-1a77-413a-bc17-af1a33441f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.430552 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85166a-1a77-413a-bc17-af1a33441f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.431242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85166a-1a77-413a-bc17-af1a33441f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:03.433134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85166a-1a77-413a-bc17-af1a33441f67 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:03.458970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1066/2130] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:03 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:03.462995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023d87b-f2ba-44d9-8407-a446bd8775f5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:03.472856 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023d87b-f2ba-44d9-8407-a446bd8775f5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:03.530750 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99f629-413e-42bc-8713-969789e76e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:03.531450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99f629-413e-42bc-8713-969789e76e2c admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.531749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99f629-413e-42bc-8713-969789e76e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.532022 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99f629-413e-42bc-8713-969789e76e2c admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.532770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99f629-413e-42bc-8713-969789e76e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:03.535464 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99f629-413e-42bc-8713-969789e76e2c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:03.561437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1065/2131] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:03 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:03.565897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85166a-1a77-413a-bc17-af1a33441f67 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:03.576756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85166a-1a77-413a-bc17-af1a33441f67 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:03.581679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90a18-34f7-4dff-91d0-cffb355e4f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:03.582314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90a18-34f7-4dff-91d0-cffb355e4f1c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.582602 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90a18-34f7-4dff-91d0-cffb355e4f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.582880 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90a18-34f7-4dff-91d0-cffb355e4f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.583761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd90a18-34f7-4dff-91d0-cffb355e4f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:03.585364 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd90a18-34f7-4dff-91d0-cffb355e4f1c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:03.595916 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1067/2132] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:03.600539 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99f629-413e-42bc-8713-969789e76e2c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:03.611058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99f629-413e-42bc-8713-969789e76e2c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:03.616940 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed24b3a-c423-46db-84bc-6138b2ec2f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:03.617766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed24b3a-c423-46db-84bc-6138b2ec2f5e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.618411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed24b3a-c423-46db-84bc-6138b2ec2f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.618810 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed24b3a-c423-46db-84bc-6138b2ec2f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.619653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed24b3a-c423-46db-84bc-6138b2ec2f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:03.621370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed24b3a-c423-46db-84bc-6138b2ec2f5e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:03.635662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1066/2133] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:39:03.637046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90a18-34f7-4dff-91d0-cffb355e4f1c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:03.647735 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90a18-34f7-4dff-91d0-cffb355e4f1c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:03.653478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a78924-8935-43a7-b424-35c1f4bf61f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:03.657373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a78924-8935-43a7-b424-35c1f4bf61f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.657373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a78924-8935-43a7-b424-35c1f4bf61f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.657373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a78924-8935-43a7-b424-35c1f4bf61f5 admin admin] PATH_INFO: `/v3/projects/87f1e8760da94274ad05a3ac10f1133a/users/61ab785c52de4d0184a5398a4dbda7c6/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.675490 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a78924-8935-43a7-b424-35c1f4bf61f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f1e8760da94274ad05a3ac10f1133a, user_id=61ab785c52de4d0184a5398a4dbda7c6, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:03.682450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a78924-8935-43a7-b424-35c1f4bf61f5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:03.697596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1068/2134] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:03 2022] PUT /identity/v3/projects/87f1e8760da94274ad05a3ac10f1133a/users/61ab785c52de4d0184a5398a4dbda7c6/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:03.707723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0225-b101-4b4e-b6ca-9afdad1ea806 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.708106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0225-b101-4b4e-b6ca-9afdad1ea806 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.708460 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0225-b101-4b4e-b6ca-9afdad1ea806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.743011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-001e0225-b101-4b4e-b6ca-9afdad1ea806 None None] MFA Rules not processed for user `61ab785c52de4d0184a5398a4dbda7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:03.744888 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-001e0225-b101-4b4e-b6ca-9afdad1ea806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:03.818194 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1067/2135] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:03.822984 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a78924-8935-43a7-b424-35c1f4bf61f5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:03.891719 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a78924-8935-43a7-b424-35c1f4bf61f5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:03.898155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a97cb-95f2-4a72-87a8-4df757caee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:03.898975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a97cb-95f2-4a72-87a8-4df757caee14 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.899261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a97cb-95f2-4a72-87a8-4df757caee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.899540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a97cb-95f2-4a72-87a8-4df757caee14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.900255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a97cb-95f2-4a72-87a8-4df757caee14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:03.902830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a97cb-95f2-4a72-87a8-4df757caee14 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:03.913361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0225-b101-4b4e-b6ca-9afdad1ea806 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:03.914938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-001e0225-b101-4b4e-b6ca-9afdad1ea806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:03.930190 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0225-b101-4b4e-b6ca-9afdad1ea806 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:03.931674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1069/2136] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:03 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:03.935540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a97cb-95f2-4a72-87a8-4df757caee14 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:03.986604 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484240-dc1f-47bc-9354-e10e2fd16a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:03.987471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484240-dc1f-47bc-9354-e10e2fd16a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.987816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484240-dc1f-47bc-9354-e10e2fd16a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.988023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484240-dc1f-47bc-9354-e10e2fd16a83 admin admin] PATH_INFO: `/v3/users/3015f33252614138b3ed72bf0e6ed067` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.989267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87484240-dc1f-47bc-9354-e10e2fd16a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3015f33252614138b3ed72bf0e6ed067)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:03.991256 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87484240-dc1f-47bc-9354-e10e2fd16a83 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:03.997650 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a97cb-95f2-4a72-87a8-4df757caee14 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.003360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4bd52-b6d3-46af-8d27-5968d10ccaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.004025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4bd52-b6d3-46af-8d27-5968d10ccaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.004307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4bd52-b6d3-46af-8d27-5968d10ccaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.004579 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4bd52-b6d3-46af-8d27-5968d10ccaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.005263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4bd52-b6d3-46af-8d27-5968d10ccaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.007787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4bd52-b6d3-46af-8d27-5968d10ccaa9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.028957 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1070/2137] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:03 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:04.032755 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4bd52-b6d3-46af-8d27-5968d10ccaa9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.037120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-87484240-dc1f-47bc-9354-e10e2fd16a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3015f33252614138b3ed72bf0e6ed067'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:04.044376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-87484240-dc1f-47bc-9354-e10e2fd16a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3015f33252614138b3ed72bf0e6ed067'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:04.051670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4bd52-b6d3-46af-8d27-5968d10ccaa9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.062593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b555b9-add5-47e9-b8f1-cbd52adba8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.063404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-87484240-dc1f-47bc-9354-e10e2fd16a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3015f33252614138b3ed72bf0e6ed067'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:04.064152 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b555b9-add5-47e9-b8f1-cbd52adba8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.064293 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-87484240-dc1f-47bc-9354-e10e2fd16a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3015f33252614138b3ed72bf0e6ed067'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:04.064433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b555b9-add5-47e9-b8f1-cbd52adba8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.064793 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b555b9-add5-47e9-b8f1-cbd52adba8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.064886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-87484240-dc1f-47bc-9354-e10e2fd16a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3015f33252614138b3ed72bf0e6ed067'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:04.065931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b555b9-add5-47e9-b8f1-cbd52adba8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.067570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b555b9-add5-47e9-b8f1-cbd52adba8f1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.079471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1068/2138] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:03 2022] DELETE /identity/v3/users/3015f33252614138b3ed72bf0e6ed067 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:04.083726 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1071/2139] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:39:04.083875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172abfbd-0982-48c9-87c9-0447e458e56e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.083875 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172abfbd-0982-48c9-87c9-0447e458e56e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.084128 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172abfbd-0982-48c9-87c9-0447e458e56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.087412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b555b9-add5-47e9-b8f1-cbd52adba8f1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.100150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c0b555b9-add5-47e9-b8f1-cbd52adba8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:04.101770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-172abfbd-0982-48c9-87c9-0447e458e56e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:04.103222 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-172abfbd-0982-48c9-87c9-0447e458e56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:04.118584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b555b9-add5-47e9-b8f1-cbd52adba8f1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.176468 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1069/2140] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:04.185717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172abfbd-0982-48c9-87c9-0447e458e56e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.189872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-172abfbd-0982-48c9-87c9-0447e458e56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:04.219646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bac74-443b-4c5a-927c-5e55c183749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.222878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bac74-443b-4c5a-927c-5e55c183749c admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.223435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bac74-443b-4c5a-927c-5e55c183749c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.224071 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bac74-443b-4c5a-927c-5e55c183749c admin admin] PATH_INFO: `/v3/projects/3009a9719bf542d79eb1c93e8e0384c2/users/76c631f0cabd413a811e83da8d83a0a9/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.241888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bac74-443b-4c5a-927c-5e55c183749c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3009a9719bf542d79eb1c93e8e0384c2, user_id=76c631f0cabd413a811e83da8d83a0a9, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.247558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bac74-443b-4c5a-927c-5e55c183749c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.270391 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1072/2141] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:04 2022] PUT /identity/v3/projects/3009a9719bf542d79eb1c93e8e0384c2/users/76c631f0cabd413a811e83da8d83a0a9/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:04.275251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bac74-443b-4c5a-927c-5e55c183749c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.284945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172abfbd-0982-48c9-87c9-0447e458e56e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.370042 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bac74-443b-4c5a-927c-5e55c183749c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.375184 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2472d16-4060-4bf8-b1b3-f7c3c1645a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.375856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2472d16-4060-4bf8-b1b3-f7c3c1645a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.376145 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2472d16-4060-4bf8-b1b3-f7c3c1645a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.376422 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2472d16-4060-4bf8-b1b3-f7c3c1645a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.377155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2472d16-4060-4bf8-b1b3-f7c3c1645a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.377891 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff5a0e-fab1-4bf0-afef-1bb4132b7260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.378710 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff5a0e-fab1-4bf0-afef-1bb4132b7260 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.378815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2472d16-4060-4bf8-b1b3-f7c3c1645a6b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.379145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff5a0e-fab1-4bf0-afef-1bb4132b7260 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.379590 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff5a0e-fab1-4bf0-afef-1bb4132b7260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.389653 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1073/2142] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:04.389807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff5a0e-fab1-4bf0-afef-1bb4132b7260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.391939 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff5a0e-fab1-4bf0-afef-1bb4132b7260 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.393590 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2472d16-4060-4bf8-b1b3-f7c3c1645a6b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.403494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1070/2143] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:04.407923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2472d16-4060-4bf8-b1b3-f7c3c1645a6b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.412565 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2789e48-babc-4016-b857-56c5cd99778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.413460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2789e48-babc-4016-b857-56c5cd99778c admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.413737 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2789e48-babc-4016-b857-56c5cd99778c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.414005 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2789e48-babc-4016-b857-56c5cd99778c admin admin] PATH_INFO: `/v3/projects/3009a9719bf542d79eb1c93e8e0384c2/users/76c631f0cabd413a811e83da8d83a0a9/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.416009 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2789e48-babc-4016-b857-56c5cd99778c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3009a9719bf542d79eb1c93e8e0384c2, user_id=76c631f0cabd413a811e83da8d83a0a9, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.418997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2789e48-babc-4016-b857-56c5cd99778c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.432826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1074/2144] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:04 2022] PUT /identity/v3/projects/3009a9719bf542d79eb1c93e8e0384c2/users/76c631f0cabd413a811e83da8d83a0a9/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:04.445023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df457ff-c604-4a6e-9cea-04d39d6d18ba None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.445559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df457ff-c604-4a6e-9cea-04d39d6d18ba None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.445927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df457ff-c604-4a6e-9cea-04d39d6d18ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.474231 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4df457ff-c604-4a6e-9cea-04d39d6d18ba None None] MFA Rules not processed for user `76c631f0cabd413a811e83da8d83a0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:04.479068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4df457ff-c604-4a6e-9cea-04d39d6d18ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:04.560936 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1071/2145] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:04.570869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2789e48-babc-4016-b857-56c5cd99778c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.572613 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f2789e48-babc-4016-b857-56c5cd99778c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:04.649114 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2789e48-babc-4016-b857-56c5cd99778c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.653833 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae91051-50bf-4aa8-b366-1d0134c49fc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.654559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae91051-50bf-4aa8-b366-1d0134c49fc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.654915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae91051-50bf-4aa8-b366-1d0134c49fc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.655200 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae91051-50bf-4aa8-b366-1d0134c49fc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.657340 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-dae91051-50bf-4aa8-b366-1d0134c49fc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:04.729373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae91051-50bf-4aa8-b366-1d0134c49fc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.731832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae91051-50bf-4aa8-b366-1d0134c49fc8 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.736238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df457ff-c604-4a6e-9cea-04d39d6d18ba None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.738773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4df457ff-c604-4a6e-9cea-04d39d6d18ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:04.744710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1075/2146] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:04.811389 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df457ff-c604-4a6e-9cea-04d39d6d18ba None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.816789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.817766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.818309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.818696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] PATH_INFO: `/v3/projects/ebd02c1041aa48818a09e37eeb85f508` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.820271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd02c1041aa48818a09e37eeb85f508)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.822811 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.879404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd02c1041aa48818a09e37eeb85f508', 'request_id': 'req-10769226-e0a4-4878-9c6e-5a7f13500066'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:04.888426 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd02c1041aa48818a09e37eeb85f508', 'request_id': 'req-10769226-e0a4-4878-9c6e-5a7f13500066'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:04.895906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd02c1041aa48818a09e37eeb85f508', 'request_id': 'req-10769226-e0a4-4878-9c6e-5a7f13500066'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:04.908432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] The token cache is being invalidate because project ebd02c1041aa48818a09e37eeb85f508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:04.908666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:04.909455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:04.911082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1072/2147] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:04 2022] DELETE /identity/v3/projects/ebd02c1041aa48818a09e37eeb85f508 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:04.916046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae91051-50bf-4aa8-b366-1d0134c49fc8 service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.928203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae91051-50bf-4aa8-b366-1d0134c49fc8 service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.992492 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6db62-6448-4788-b32f-1e630be45aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.993719 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6db62-6448-4788-b32f-1e630be45aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.994028 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6db62-6448-4788-b32f-1e630be45aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.994471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6db62-6448-4788-b32f-1e630be45aef admin admin] PATH_INFO: `/v3/users/279abc10212a4da1ae7169726a484278` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.996117 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6db62-6448-4788-b32f-1e630be45aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=279abc10212a4da1ae7169726a484278)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.998075 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6db62-6448-4788-b32f-1e630be45aef admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:05.084965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fbd6db62-6448-4788-b32f-1e630be45aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279abc10212a4da1ae7169726a484278'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:05.101447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fbd6db62-6448-4788-b32f-1e630be45aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279abc10212a4da1ae7169726a484278'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:05.116928 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fbd6db62-6448-4788-b32f-1e630be45aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279abc10212a4da1ae7169726a484278'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:05.117812 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fbd6db62-6448-4788-b32f-1e630be45aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279abc10212a4da1ae7169726a484278'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:05.126972 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fbd6db62-6448-4788-b32f-1e630be45aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279abc10212a4da1ae7169726a484278'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:05.134621 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1076/2148] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:04 2022] DELETE /identity/v3/users/279abc10212a4da1ae7169726a484278 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:05.451757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:05.454681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:05.488905 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10769226-e0a4-4878-9c6e-5a7f13500066 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:05.566797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f51920-0a32-4998-b185-55e8091870af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:05.567653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f51920-0a32-4998-b185-55e8091870af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:05.567931 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f51920-0a32-4998-b185-55e8091870af admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:05.568895 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f51920-0a32-4998-b185-55e8091870af admin admin] PATH_INFO: `/v3/projects/a56cfa2c3f32411895840c42c69747c0` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:05.570337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f51920-0a32-4998-b185-55e8091870af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56cfa2c3f32411895840c42c69747c0)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:05.572445 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f51920-0a32-4998-b185-55e8091870af admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:05.623959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e8f51920-0a32-4998-b185-55e8091870af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56cfa2c3f32411895840c42c69747c0', 'request_id': 'req-e8f51920-0a32-4998-b185-55e8091870af'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:05.630433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e8f51920-0a32-4998-b185-55e8091870af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56cfa2c3f32411895840c42c69747c0', 'request_id': 'req-e8f51920-0a32-4998-b185-55e8091870af'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:05.638679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e8f51920-0a32-4998-b185-55e8091870af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56cfa2c3f32411895840c42c69747c0', 'request_id': 'req-e8f51920-0a32-4998-b185-55e8091870af'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:05.650274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e8f51920-0a32-4998-b185-55e8091870af admin admin] The token cache is being invalidate because project a56cfa2c3f32411895840c42c69747c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:05.650878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e8f51920-0a32-4998-b185-55e8091870af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:05.651860 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e8f51920-0a32-4998-b185-55e8091870af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:05.653818 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1073/2149] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:05 2022] DELETE /identity/v3/projects/a56cfa2c3f32411895840c42c69747c0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:05.659651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb5c1f-e5fd-4edc-8237-8ec09ff45209 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:05.660563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb5c1f-e5fd-4edc-8237-8ec09ff45209 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:05.660880 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb5c1f-e5fd-4edc-8237-8ec09ff45209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:05.679384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-1bbb5c1f-e5fd-4edc-8237-8ec09ff45209 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:05.680557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1bbb5c1f-e5fd-4edc-8237-8ec09ff45209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:05.735669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1077/2150] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:05.744525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977aa7d-9211-4337-bba0-e45a424260a8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:05.744814 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977aa7d-9211-4337-bba0-e45a424260a8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:05.745096 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977aa7d-9211-4337-bba0-e45a424260a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:05.764921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4977aa7d-9211-4337-bba0-e45a424260a8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:05.766132 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4977aa7d-9211-4337-bba0-e45a424260a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:05.774605 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1074/2151] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:05.778974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb5c1f-e5fd-4edc-8237-8ec09ff45209 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:05.793475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb5c1f-e5fd-4edc-8237-8ec09ff45209 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:05.799149 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c2bc1-f27b-4399-98b8-d8f2c8d0ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:05.799961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c2bc1-f27b-4399-98b8-d8f2c8d0ee97 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:05.800208 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c2bc1-f27b-4399-98b8-d8f2c8d0ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:05.800623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c2bc1-f27b-4399-98b8-d8f2c8d0ee97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:05.801520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c2bc1-f27b-4399-98b8-d8f2c8d0ee97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:39:05.801827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c2bc1-f27b-4399-98b8-d8f2c8d0ee97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:05.804617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c2bc1-f27b-4399-98b8-d8f2c8d0ee97 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:05.822027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1078/2152] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:39:05.823524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977aa7d-9211-4337-bba0-e45a424260a8 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:05.833284 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977aa7d-9211-4337-bba0-e45a424260a8 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:05.838153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2e00a-c1b0-4054-ad82-d80d2e738f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:05.838883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2e00a-c1b0-4054-ad82-d80d2e738f18 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:05.839170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2e00a-c1b0-4054-ad82-d80d2e738f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:05.839445 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2e00a-c1b0-4054-ad82-d80d2e738f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:05.840142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2e00a-c1b0-4054-ad82-d80d2e738f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:05.842098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2e00a-c1b0-4054-ad82-d80d2e738f18 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:05.870956 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1075/2153] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:05 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:05.874872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c2bc1-f27b-4399-98b8-d8f2c8d0ee97 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:05.886949 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c2bc1-f27b-4399-98b8-d8f2c8d0ee97 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:05.948899 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12437c5f-82bd-4101-9218-2f992447b807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:05.949566 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12437c5f-82bd-4101-9218-2f992447b807 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:05.949852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12437c5f-82bd-4101-9218-2f992447b807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:05.950129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12437c5f-82bd-4101-9218-2f992447b807 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:05.950847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12437c5f-82bd-4101-9218-2f992447b807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:05.952755 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12437c5f-82bd-4101-9218-2f992447b807 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:05.972345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1079/2154] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:05 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:05.976638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2e00a-c1b0-4054-ad82-d80d2e738f18 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:05.987432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2e00a-c1b0-4054-ad82-d80d2e738f18 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:05.992280 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7278-5472-4761-afa3-9d95b192259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:05.992939 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7278-5472-4761-afa3-9d95b192259e admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:05.993485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7278-5472-4761-afa3-9d95b192259e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:05.993758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7278-5472-4761-afa3-9d95b192259e admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:05.994544 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc7278-5472-4761-afa3-9d95b192259e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:05.996129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc7278-5472-4761-afa3-9d95b192259e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:06.006780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1076/2155] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:06.010818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12437c5f-82bd-4101-9218-2f992447b807 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:06.021347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12437c5f-82bd-4101-9218-2f992447b807 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:06.026889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6556a9-c1ef-4d38-88fe-06b50a95106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:06.027543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6556a9-c1ef-4d38-88fe-06b50a95106c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.027827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6556a9-c1ef-4d38-88fe-06b50a95106c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.028100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6556a9-c1ef-4d38-88fe-06b50a95106c admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.028851 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6556a9-c1ef-4d38-88fe-06b50a95106c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:06.030489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6556a9-c1ef-4d38-88fe-06b50a95106c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:06.040943 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1080/2156] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:06.045368 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7278-5472-4761-afa3-9d95b192259e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:06.055835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7278-5472-4761-afa3-9d95b192259e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:06.060514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef705072-80f9-4ebc-9418-cc495ac3b5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:06.061381 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705072-80f9-4ebc-9418-cc495ac3b5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.061662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705072-80f9-4ebc-9418-cc495ac3b5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.061935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705072-80f9-4ebc-9418-cc495ac3b5d8 admin admin] PATH_INFO: `/v3/projects/3e7af6ba583c4dd1b2fc1ae34a40c00a/users/ef3c4b1617bc461b8e4335215349ff92/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.076200 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef705072-80f9-4ebc-9418-cc495ac3b5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7af6ba583c4dd1b2fc1ae34a40c00a, user_id=ef3c4b1617bc461b8e4335215349ff92, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:06.078905 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef705072-80f9-4ebc-9418-cc495ac3b5d8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:06.103299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1077/2157] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:06 2022] PUT /identity/v3/projects/3e7af6ba583c4dd1b2fc1ae34a40c00a/users/ef3c4b1617bc461b8e4335215349ff92/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:06.117486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4a88c-fa48-445b-a2ef-0aaef862d7a7 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.117768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4a88c-fa48-445b-a2ef-0aaef862d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.118332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4a88c-fa48-445b-a2ef-0aaef862d7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.146192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-59f4a88c-fa48-445b-a2ef-0aaef862d7a7 None None] MFA Rules not processed for user `ef3c4b1617bc461b8e4335215349ff92`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:06.147374 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-59f4a88c-fa48-445b-a2ef-0aaef862d7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:06.227023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1081/2158] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:06.231893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef705072-80f9-4ebc-9418-cc495ac3b5d8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:06.304318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef705072-80f9-4ebc-9418-cc495ac3b5d8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:06.309060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42648261-e837-4584-8a05-90c9450216f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:06.309707 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42648261-e837-4584-8a05-90c9450216f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.309987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42648261-e837-4584-8a05-90c9450216f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.310294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42648261-e837-4584-8a05-90c9450216f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.310975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42648261-e837-4584-8a05-90c9450216f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:06.312845 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42648261-e837-4584-8a05-90c9450216f8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:06.341265 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1078/2159] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:06 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:06.345583 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4a88c-fa48-445b-a2ef-0aaef862d7a7 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:06.356152 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4a88c-fa48-445b-a2ef-0aaef862d7a7 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:06.416626 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e9ec0-b9e4-4881-9212-17cfd338a418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:06.417224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e9ec0-b9e4-4881-9212-17cfd338a418 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.417503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e9ec0-b9e4-4881-9212-17cfd338a418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.417775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e9ec0-b9e4-4881-9212-17cfd338a418 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.418505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e9ec0-b9e4-4881-9212-17cfd338a418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:06.420558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e9ec0-b9e4-4881-9212-17cfd338a418 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:06.453328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1082/2160] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:06 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:06.454308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42648261-e837-4584-8a05-90c9450216f8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:06.473055 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42648261-e837-4584-8a05-90c9450216f8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:06.473055 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11416c61-6e7f-47f2-b704-82443128a3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:06.473055 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11416c61-6e7f-47f2-b704-82443128a3dc admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.473055 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11416c61-6e7f-47f2-b704-82443128a3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.473524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11416c61-6e7f-47f2-b704-82443128a3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.473715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11416c61-6e7f-47f2-b704-82443128a3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:06.475992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11416c61-6e7f-47f2-b704-82443128a3dc admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:06.488015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1079/2161] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:39:06.495462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e9ec0-b9e4-4881-9212-17cfd338a418 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:06.505471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e9ec0-b9e4-4881-9212-17cfd338a418 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:06.510430 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cfecf-49e0-46d2-af25-81809d84b009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:06.511325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cfecf-49e0-46d2-af25-81809d84b009 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.511758 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cfecf-49e0-46d2-af25-81809d84b009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.512032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cfecf-49e0-46d2-af25-81809d84b009 admin admin] PATH_INFO: `/v3/projects/e6797f34b4504ad1b1bd2824de93040a/users/714739a586774053a9a4446326c00830/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.530983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cfecf-49e0-46d2-af25-81809d84b009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6797f34b4504ad1b1bd2824de93040a, user_id=714739a586774053a9a4446326c00830, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:06.533746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cfecf-49e0-46d2-af25-81809d84b009 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:06.549921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1083/2162] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:06 2022] PUT /identity/v3/projects/e6797f34b4504ad1b1bd2824de93040a/users/714739a586774053a9a4446326c00830/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:06.551596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11416c61-6e7f-47f2-b704-82443128a3dc admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:06.561975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11416c61-6e7f-47f2-b704-82443128a3dc admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:06.619466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7a9a1-9456-4251-b2e4-da7b12f263a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:06.620135 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7a9a1-9456-4251-b2e4-da7b12f263a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.620414 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7a9a1-9456-4251-b2e4-da7b12f263a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.620685 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7a9a1-9456-4251-b2e4-da7b12f263a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.621410 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7a9a1-9456-4251-b2e4-da7b12f263a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:06.623034 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7a9a1-9456-4251-b2e4-da7b12f263a5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:06.632292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1080/2163] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:06.636356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cfecf-49e0-46d2-af25-81809d84b009 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:06.648445 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cfecf-49e0-46d2-af25-81809d84b009 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:06.653767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3479bc-7958-4c17-ad0f-a69e54e3eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:06.654834 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3479bc-7958-4c17-ad0f-a69e54e3eb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.655137 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3479bc-7958-4c17-ad0f-a69e54e3eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.655438 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3479bc-7958-4c17-ad0f-a69e54e3eb84 admin admin] PATH_INFO: `/v3/projects/e6797f34b4504ad1b1bd2824de93040a/users/714739a586774053a9a4446326c00830/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.657689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3479bc-7958-4c17-ad0f-a69e54e3eb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6797f34b4504ad1b1bd2824de93040a, user_id=714739a586774053a9a4446326c00830, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:06.660507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3479bc-7958-4c17-ad0f-a69e54e3eb84 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:06.672151 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1084/2164] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:06 2022] PUT /identity/v3/projects/e6797f34b4504ad1b1bd2824de93040a/users/714739a586774053a9a4446326c00830/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:06.683031 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902297f9-d556-4cd7-9c96-928bacac31c8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.683284 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902297f9-d556-4cd7-9c96-928bacac31c8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.683563 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902297f9-d556-4cd7-9c96-928bacac31c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.710541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-902297f9-d556-4cd7-9c96-928bacac31c8 None None] MFA Rules not processed for user `714739a586774053a9a4446326c00830`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:06.711748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-902297f9-d556-4cd7-9c96-928bacac31c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:06.783899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1081/2165] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:06.794853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3479bc-7958-4c17-ad0f-a69e54e3eb84 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:06.796583 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ef3479bc-7958-4c17-ad0f-a69e54e3eb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:06.857513 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3479bc-7958-4c17-ad0f-a69e54e3eb84 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:06.861450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed39a6-5b1c-44c4-b4a6-773dbfa393c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:06.862109 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed39a6-5b1c-44c4-b4a6-773dbfa393c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.862427 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed39a6-5b1c-44c4-b4a6-773dbfa393c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.862705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed39a6-5b1c-44c4-b4a6-773dbfa393c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.873743 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed39a6-5b1c-44c4-b4a6-773dbfa393c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:06.874948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed39a6-5b1c-44c4-b4a6-773dbfa393c7 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:06.885385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1085/2166] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:06.976699 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902297f9-d556-4cd7-9c96-928bacac31c8 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:06.985833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902297f9-d556-4cd7-9c96-928bacac31c8 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:06.989542 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60276e-e147-453e-97f6-0d4be0084633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:06.990295 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60276e-e147-453e-97f6-0d4be0084633 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.990556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60276e-e147-453e-97f6-0d4be0084633 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.990809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60276e-e147-453e-97f6-0d4be0084633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:07.054907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60276e-e147-453e-97f6-0d4be0084633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:07.056603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60276e-e147-453e-97f6-0d4be0084633 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:07.065835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1082/2167] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:07.315169 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed39a6-5b1c-44c4-b4a6-773dbfa393c7 service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:07.320469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-63ed39a6-5b1c-44c4-b4a6-773dbfa393c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:07.354855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60276e-e147-453e-97f6-0d4be0084633 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:07.356257 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-1c60276e-e147-453e-97f6-0d4be0084633 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:07.422560 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed39a6-5b1c-44c4-b4a6-773dbfa393c7 service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:07.427158 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32936582-207b-451f-9b48-199c9e3c05ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:07.428923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32936582-207b-451f-9b48-199c9e3c05ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:07.429194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32936582-207b-451f-9b48-199c9e3c05ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:07.429683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32936582-207b-451f-9b48-199c9e3c05ad admin admin] PATH_INFO: `/v3/users/043b79a846ed41a6a446a1c533068af9` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:07.434333 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32936582-207b-451f-9b48-199c9e3c05ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=043b79a846ed41a6a446a1c533068af9)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:07.434333 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32936582-207b-451f-9b48-199c9e3c05ad admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:07.436802 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60276e-e147-453e-97f6-0d4be0084633 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:07.442690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:07.443973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:07.444361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:07.444623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] PATH_INFO: `/v3/users/61ab785c52de4d0184a5398a4dbda7c6` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:07.446067 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ab785c52de4d0184a5398a4dbda7c6)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:07.448207 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:07.491753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-32936582-207b-451f-9b48-199c9e3c05ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043b79a846ed41a6a446a1c533068af9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:07.503003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-32936582-207b-451f-9b48-199c9e3c05ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043b79a846ed41a6a446a1c533068af9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:07.504484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ab785c52de4d0184a5398a4dbda7c6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:07.515432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ab785c52de4d0184a5398a4dbda7c6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:07.520994 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-32936582-207b-451f-9b48-199c9e3c05ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043b79a846ed41a6a446a1c533068af9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:07.522164 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-32936582-207b-451f-9b48-199c9e3c05ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043b79a846ed41a6a446a1c533068af9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:07.530064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ab785c52de4d0184a5398a4dbda7c6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:07.532404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ab785c52de4d0184a5398a4dbda7c6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:07.533155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ab785c52de4d0184a5398a4dbda7c6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:07.537437 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-32936582-207b-451f-9b48-199c9e3c05ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043b79a846ed41a6a446a1c533068af9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:07.543754 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1086/2168] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:07 2022] DELETE /identity/v3/users/043b79a846ed41a6a446a1c533068af9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:07.548089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1083/2169] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:07 2022] DELETE /identity/v3/users/61ab785c52de4d0184a5398a4dbda7c6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:07.552250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6767c0b-75df-4266-8dc3-a3e8c3e1afd0 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:07.553265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6767c0b-75df-4266-8dc3-a3e8c3e1afd0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:07.553690 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6767c0b-75df-4266-8dc3-a3e8c3e1afd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:07.571198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b6767c0b-75df-4266-8dc3-a3e8c3e1afd0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:07.572404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b6767c0b-75df-4266-8dc3-a3e8c3e1afd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:07.640348 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1087/2170] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:07.651081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:07.653156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:07.725351 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3208d49-e8e4-4092-88b5-5bbda538411d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:07.729088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62424bdc-25bf-4975-b107-50ac5c727360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:07.729776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62424bdc-25bf-4975-b107-50ac5c727360 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:07.730054 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62424bdc-25bf-4975-b107-50ac5c727360 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:07.730371 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62424bdc-25bf-4975-b107-50ac5c727360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:07.740299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62424bdc-25bf-4975-b107-50ac5c727360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:07.741749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62424bdc-25bf-4975-b107-50ac5c727360 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:07.753493 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1084/2171] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:07.947408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6767c0b-75df-4266-8dc3-a3e8c3e1afd0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:07.948849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b6767c0b-75df-4266-8dc3-a3e8c3e1afd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:07.969137 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6767c0b-75df-4266-8dc3-a3e8c3e1afd0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:07.974335 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:07.975209 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:07.975552 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:07.975766 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2 admin admin] PATH_INFO: `/v3/projects/dc95cdaceac64f92ac8ca5b296ce7e33` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:07.976964 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc95cdaceac64f92ac8ca5b296ce7e33)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:07.980242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:08.034261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc95cdaceac64f92ac8ca5b296ce7e33', 'request_id': 'req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.041073 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc95cdaceac64f92ac8ca5b296ce7e33', 'request_id': 'req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.050444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc95cdaceac64f92ac8ca5b296ce7e33', 'request_id': 'req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.054919 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62424bdc-25bf-4975-b107-50ac5c727360 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:08.056298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-62424bdc-25bf-4975-b107-50ac5c727360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:08.067299 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2 admin admin] The token cache is being invalidate because project dc95cdaceac64f92ac8ca5b296ce7e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:08.067579 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.068746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-efcd3e61-09a5-4ba3-8b36-e1fd4ce47ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.069898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62424bdc-25bf-4975-b107-50ac5c727360 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:08.070321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1088/2172] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:07 2022] DELETE /identity/v3/projects/dc95cdaceac64f92ac8ca5b296ce7e33 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:08.076319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e3ed3-68a2-4cc7-8e9a-06a5baebcd4f None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.076673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e3ed3-68a2-4cc7-8e9a-06a5baebcd4f None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.076955 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e3ed3-68a2-4cc7-8e9a-06a5baebcd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.100751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-351e3ed3-68a2-4cc7-8e9a-06a5baebcd4f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:08.102769 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-351e3ed3-68a2-4cc7-8e9a-06a5baebcd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:08.140762 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:08.141635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.141913 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.142187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] PATH_INFO: `/v3/projects/87f1e8760da94274ad05a3ac10f1133a` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.143411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f1e8760da94274ad05a3ac10f1133a)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:08.145401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:08.165436 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1089/2173] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:08.174097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68629c8-c6f4-4b4c-983c-678efd9dedef None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.174493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68629c8-c6f4-4b4c-983c-678efd9dedef None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.174773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68629c8-c6f4-4b4c-983c-678efd9dedef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.190356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f1e8760da94274ad05a3ac10f1133a', 'request_id': 'req-100e5d40-b152-41be-8db1-3280d2cd7262'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.191930 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-e68629c8-c6f4-4b4c-983c-678efd9dedef None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:08.193658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e68629c8-c6f4-4b4c-983c-678efd9dedef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:08.197785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f1e8760da94274ad05a3ac10f1133a', 'request_id': 'req-100e5d40-b152-41be-8db1-3280d2cd7262'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.207039 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f1e8760da94274ad05a3ac10f1133a', 'request_id': 'req-100e5d40-b152-41be-8db1-3280d2cd7262'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.220426 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] The token cache is being invalidate because project 87f1e8760da94274ad05a3ac10f1133a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:08.220716 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.221523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.223392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1085/2174] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:08 2022] DELETE /identity/v3/projects/87f1e8760da94274ad05a3ac10f1133a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:08.227565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:08.229208 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:08.259376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1090/2175] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:08.263641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68629c8-c6f4-4b4c-983c-678efd9dedef None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:08.272979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68629c8-c6f4-4b4c-983c-678efd9dedef None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:08.278233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6726b2-08f7-4382-84e4-2f17d03d25f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:08.278913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6726b2-08f7-4382-84e4-2f17d03d25f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.279195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6726b2-08f7-4382-84e4-2f17d03d25f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.279468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6726b2-08f7-4382-84e4-2f17d03d25f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.280203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6726b2-08f7-4382-84e4-2f17d03d25f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:39:08.280512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6726b2-08f7-4382-84e4-2f17d03d25f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:08.282118 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6726b2-08f7-4382-84e4-2f17d03d25f6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:08.293717 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1091/2176] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:39:08.294433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e5d40-b152-41be-8db1-3280d2cd7262 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:08.298053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6726b2-08f7-4382-84e4-2f17d03d25f6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:08.299077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:08.299940 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.300224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.300494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] PATH_INFO: `/v3/users/76c631f0cabd413a811e83da8d83a0a9` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.301696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c631f0cabd413a811e83da8d83a0a9)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:08.304235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:08.309526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6726b2-08f7-4382-84e4-2f17d03d25f6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:08.313996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225efee8-bdd8-476c-8a5e-f1e3a665dc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:08.314682 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225efee8-bdd8-476c-8a5e-f1e3a665dc5b admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.314967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225efee8-bdd8-476c-8a5e-f1e3a665dc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.315243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225efee8-bdd8-476c-8a5e-f1e3a665dc5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.315936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225efee8-bdd8-476c-8a5e-f1e3a665dc5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:08.317846 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225efee8-bdd8-476c-8a5e-f1e3a665dc5b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:08.346134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1092/2177] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:08 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:08.350614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225efee8-bdd8-476c-8a5e-f1e3a665dc5b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:08.352016 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c631f0cabd413a811e83da8d83a0a9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.360067 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c631f0cabd413a811e83da8d83a0a9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.372777 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c631f0cabd413a811e83da8d83a0a9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.373560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c631f0cabd413a811e83da8d83a0a9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.374247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c631f0cabd413a811e83da8d83a0a9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.393822 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1086/2178] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:08 2022] DELETE /identity/v3/users/76c631f0cabd413a811e83da8d83a0a9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:08.419948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225efee8-bdd8-476c-8a5e-f1e3a665dc5b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:08.477239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e2d3a-2a15-4464-abb0-70609a196834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:08.477969 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e2d3a-2a15-4464-abb0-70609a196834 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.478191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e2d3a-2a15-4464-abb0-70609a196834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.478505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e2d3a-2a15-4464-abb0-70609a196834 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.479194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e2d3a-2a15-4464-abb0-70609a196834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:08.481200 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e2d3a-2a15-4464-abb0-70609a196834 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:08.504079 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1093/2179] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:08 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:08.508942 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:08.510596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:08.525659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d396af-635f-46bc-8a9a-2d6adb697ed4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:08.530941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0464ec6-65e4-4379-9306-1e58d4de4cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:08.531236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464ec6-65e4-4379-9306-1e58d4de4cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.531765 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464ec6-65e4-4379-9306-1e58d4de4cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.532365 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464ec6-65e4-4379-9306-1e58d4de4cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.532832 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0464ec6-65e4-4379-9306-1e58d4de4cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:08.535328 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0464ec6-65e4-4379-9306-1e58d4de4cf1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:08.549621 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1087/2180] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:08.554063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e2d3a-2a15-4464-abb0-70609a196834 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:08.564626 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e2d3a-2a15-4464-abb0-70609a196834 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:08.573348 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3113a4-97c9-490b-9c47-de1839a8c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:08.573999 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3113a4-97c9-490b-9c47-de1839a8c641 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.574354 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3113a4-97c9-490b-9c47-de1839a8c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.574715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3113a4-97c9-490b-9c47-de1839a8c641 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.577432 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3113a4-97c9-490b-9c47-de1839a8c641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:08.579123 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3113a4-97c9-490b-9c47-de1839a8c641 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:08.598043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1094/2181] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:08.599594 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0464ec6-65e4-4379-9306-1e58d4de4cf1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:08.619725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0464ec6-65e4-4379-9306-1e58d4de4cf1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:08.625201 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243c285-2399-49b9-b050-1ba7d6e4322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:08.626224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243c285-2399-49b9-b050-1ba7d6e4322c admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.626505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243c285-2399-49b9-b050-1ba7d6e4322c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.626785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243c285-2399-49b9-b050-1ba7d6e4322c admin admin] PATH_INFO: `/v3/projects/1d5b71bc1bf2467dada53f1eb9447438/users/64a37cb9bd2847ee8ec6124cea770c90/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.672571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243c285-2399-49b9-b050-1ba7d6e4322c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5b71bc1bf2467dada53f1eb9447438, user_id=64a37cb9bd2847ee8ec6124cea770c90, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:08.676010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243c285-2399-49b9-b050-1ba7d6e4322c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:08.694929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1088/2182] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:08 2022] PUT /identity/v3/projects/1d5b71bc1bf2467dada53f1eb9447438/users/64a37cb9bd2847ee8ec6124cea770c90/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:08.699814 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32260b1b-894e-4942-81ee-03cfc22c0a59 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.700351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32260b1b-894e-4942-81ee-03cfc22c0a59 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.700727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32260b1b-894e-4942-81ee-03cfc22c0a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.726346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-32260b1b-894e-4942-81ee-03cfc22c0a59 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:08.726346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-32260b1b-894e-4942-81ee-03cfc22c0a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:08.739345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243c285-2399-49b9-b050-1ba7d6e4322c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:08.742571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9243c285-2399-49b9-b050-1ba7d6e4322c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:08.810027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1095/2183] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:08.816047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243c285-2399-49b9-b050-1ba7d6e4322c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:08.819779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32260b1b-894e-4942-81ee-03cfc22c0a59 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:08.821385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-32260b1b-894e-4942-81ee-03cfc22c0a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:08.823844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2585d8f-7bdc-46e0-a735-aea3e0427a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:08.824899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585d8f-7bdc-46e0-a735-aea3e0427a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.825519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585d8f-7bdc-46e0-a735-aea3e0427a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.825946 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585d8f-7bdc-46e0-a735-aea3e0427a57 admin admin] PATH_INFO: `/v3/projects/3009a9719bf542d79eb1c93e8e0384c2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.827399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2585d8f-7bdc-46e0-a735-aea3e0427a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3009a9719bf542d79eb1c93e8e0384c2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:08.831125 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2585d8f-7bdc-46e0-a735-aea3e0427a57 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:08.878595 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32260b1b-894e-4942-81ee-03cfc22c0a59 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:08.878898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e2585d8f-7bdc-46e0-a735-aea3e0427a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3009a9719bf542d79eb1c93e8e0384c2', 'request_id': 'req-e2585d8f-7bdc-46e0-a735-aea3e0427a57'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.884845 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e2585d8f-7bdc-46e0-a735-aea3e0427a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3009a9719bf542d79eb1c93e8e0384c2', 'request_id': 'req-e2585d8f-7bdc-46e0-a735-aea3e0427a57'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.893926 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e2585d8f-7bdc-46e0-a735-aea3e0427a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3009a9719bf542d79eb1c93e8e0384c2', 'request_id': 'req-e2585d8f-7bdc-46e0-a735-aea3e0427a57'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.906522 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e2585d8f-7bdc-46e0-a735-aea3e0427a57 admin admin] The token cache is being invalidate because project 3009a9719bf542d79eb1c93e8e0384c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:08.906854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e2585d8f-7bdc-46e0-a735-aea3e0427a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.907477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e2585d8f-7bdc-46e0-a735-aea3e0427a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:08.909029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1089/2184] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:08 2022] DELETE /identity/v3/projects/3009a9719bf542d79eb1c93e8e0384c2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:08.914320 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa00e7e-23a6-4a4c-96e6-645959d12b42 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.914613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa00e7e-23a6-4a4c-96e6-645959d12b42 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.914896 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa00e7e-23a6-4a4c-96e6-645959d12b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.930120 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116de1b2-c074-4573-9e49-3442992b8536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:08.930870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116de1b2-c074-4573-9e49-3442992b8536 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:08.931155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116de1b2-c074-4573-9e49-3442992b8536 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:08.931435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116de1b2-c074-4573-9e49-3442992b8536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:08.933229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-116de1b2-c074-4573-9e49-3442992b8536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:08.933486 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-dfa00e7e-23a6-4a4c-96e6-645959d12b42 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:08.934797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-dfa00e7e-23a6-4a4c-96e6-645959d12b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:08.996508 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1090/2185] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:08.997263 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116de1b2-c074-4573-9e49-3442992b8536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:08.999177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116de1b2-c074-4573-9e49-3442992b8536 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:09.004090 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cf177-5839-41cd-b955-f142b5145079 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.004378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cf177-5839-41cd-b955-f142b5145079 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.004655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cf177-5839-41cd-b955-f142b5145079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.009497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1096/2186] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:39:09.022449 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-df5cf177-5839-41cd-b955-f142b5145079 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:09.023646 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-df5cf177-5839-41cd-b955-f142b5145079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:09.033661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1091/2187] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:09.039366 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116de1b2-c074-4573-9e49-3442992b8536 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:09.048832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116de1b2-c074-4573-9e49-3442992b8536 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:09.054323 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47b2d-f114-4b0c-9b4f-67344b673444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:09.054984 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47b2d-f114-4b0c-9b4f-67344b673444 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.055268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47b2d-f114-4b0c-9b4f-67344b673444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.055545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47b2d-f114-4b0c-9b4f-67344b673444 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.056276 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47b2d-f114-4b0c-9b4f-67344b673444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:39:09.056584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47b2d-f114-4b0c-9b4f-67344b673444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:09.058177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47b2d-f114-4b0c-9b4f-67344b673444 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:09.069897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1097/2188] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:39:09.074498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cf177-5839-41cd-b955-f142b5145079 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:09.084684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cf177-5839-41cd-b955-f142b5145079 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:09.101112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e1d5-945b-4840-8a0e-9d60254c9a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:09.101897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e1d5-945b-4840-8a0e-9d60254c9a59 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.102178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e1d5-945b-4840-8a0e-9d60254c9a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.102509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e1d5-945b-4840-8a0e-9d60254c9a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.103217 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39e1d5-945b-4840-8a0e-9d60254c9a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:09.105333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39e1d5-945b-4840-8a0e-9d60254c9a59 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:09.132274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1092/2189] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:09 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:09.136408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47b2d-f114-4b0c-9b4f-67344b673444 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:09.148447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47b2d-f114-4b0c-9b4f-67344b673444 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:09.214789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cc01e-7851-430c-90f0-47802abd39ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:09.215486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cc01e-7851-430c-90f0-47802abd39ee admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.215770 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cc01e-7851-430c-90f0-47802abd39ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.216045 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cc01e-7851-430c-90f0-47802abd39ee admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.216754 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cc01e-7851-430c-90f0-47802abd39ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:09.218869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cc01e-7851-430c-90f0-47802abd39ee admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:09.246879 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1098/2190] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:09 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:09.248602 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e1d5-945b-4840-8a0e-9d60254c9a59 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:09.258682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e1d5-945b-4840-8a0e-9d60254c9a59 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:09.263211 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a42c5-2e94-4ee0-a0e7-2b8d94bfa666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:09.263969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a42c5-2e94-4ee0-a0e7-2b8d94bfa666 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.264266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a42c5-2e94-4ee0-a0e7-2b8d94bfa666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.264540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a42c5-2e94-4ee0-a0e7-2b8d94bfa666 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.265299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a42c5-2e94-4ee0-a0e7-2b8d94bfa666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:09.266969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a42c5-2e94-4ee0-a0e7-2b8d94bfa666 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:09.277781 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1093/2191] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:09.281661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cc01e-7851-430c-90f0-47802abd39ee admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:09.292627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cc01e-7851-430c-90f0-47802abd39ee admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:09.298147 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d17b86-4846-4e6e-bff6-d92268ad26ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:09.302340 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d17b86-4846-4e6e-bff6-d92268ad26ff admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.302340 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d17b86-4846-4e6e-bff6-d92268ad26ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.302340 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d17b86-4846-4e6e-bff6-d92268ad26ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.302340 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d17b86-4846-4e6e-bff6-d92268ad26ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:09.302340 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d17b86-4846-4e6e-bff6-d92268ad26ff admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:09.314319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1099/2192] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:09.319247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a42c5-2e94-4ee0-a0e7-2b8d94bfa666 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:09.346642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a42c5-2e94-4ee0-a0e7-2b8d94bfa666 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:09.352666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291a8b2-5817-46b4-a0aa-7a0f2bd3a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:09.353575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291a8b2-5817-46b4-a0aa-7a0f2bd3a008 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.353861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291a8b2-5817-46b4-a0aa-7a0f2bd3a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.354159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291a8b2-5817-46b4-a0aa-7a0f2bd3a008 admin admin] PATH_INFO: `/v3/projects/7b3173ba0ddf495fbe475a5b657f9e8b/users/11f3030c009a45a2b81581db9fd3851c/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.375926 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291a8b2-5817-46b4-a0aa-7a0f2bd3a008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3173ba0ddf495fbe475a5b657f9e8b, user_id=11f3030c009a45a2b81581db9fd3851c, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:09.379356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291a8b2-5817-46b4-a0aa-7a0f2bd3a008 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:09.395159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1094/2193] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:09 2022] PUT /identity/v3/projects/7b3173ba0ddf495fbe475a5b657f9e8b/users/11f3030c009a45a2b81581db9fd3851c/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:09.406564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a25d24-5046-435d-bebc-b1ec46d284f0 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.407168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a25d24-5046-435d-bebc-b1ec46d284f0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.407523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a25d24-5046-435d-bebc-b1ec46d284f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.443596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-17a25d24-5046-435d-bebc-b1ec46d284f0 None None] MFA Rules not processed for user `11f3030c009a45a2b81581db9fd3851c`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:09.444984 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-17a25d24-5046-435d-bebc-b1ec46d284f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:09.514718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1100/2194] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:09.519574 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291a8b2-5817-46b4-a0aa-7a0f2bd3a008 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:09.582280 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291a8b2-5817-46b4-a0aa-7a0f2bd3a008 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:09.590579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922521d0-0f5c-446a-99c4-f685edd4108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:09.590957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922521d0-0f5c-446a-99c4-f685edd4108a admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.591234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922521d0-0f5c-446a-99c4-f685edd4108a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.591500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922521d0-0f5c-446a-99c4-f685edd4108a admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.592192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922521d0-0f5c-446a-99c4-f685edd4108a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:09.594097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922521d0-0f5c-446a-99c4-f685edd4108a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:09.626515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1095/2195] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:09 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:09.631359 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a25d24-5046-435d-bebc-b1ec46d284f0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:09.648464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a25d24-5046-435d-bebc-b1ec46d284f0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:09.716142 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87305b33-4137-4c08-ac6c-84ae6853c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:09.716930 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87305b33-4137-4c08-ac6c-84ae6853c1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.717220 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87305b33-4137-4c08-ac6c-84ae6853c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.717499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87305b33-4137-4c08-ac6c-84ae6853c1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.718300 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87305b33-4137-4c08-ac6c-84ae6853c1b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:09.721134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87305b33-4137-4c08-ac6c-84ae6853c1b8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:09.774645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1101/2196] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:09 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:09.778777 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922521d0-0f5c-446a-99c4-f685edd4108a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:09.790585 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922521d0-0f5c-446a-99c4-f685edd4108a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:09.796042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af74332-a85e-46e9-8c34-a62643b470a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:09.796644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af74332-a85e-46e9-8c34-a62643b470a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.797015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af74332-a85e-46e9-8c34-a62643b470a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.797359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af74332-a85e-46e9-8c34-a62643b470a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.798378 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af74332-a85e-46e9-8c34-a62643b470a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:09.800264 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af74332-a85e-46e9-8c34-a62643b470a5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:09.811862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1096/2197] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:09.817097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87305b33-4137-4c08-ac6c-84ae6853c1b8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:09.833395 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87305b33-4137-4c08-ac6c-84ae6853c1b8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:09.839576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f6868-883b-4cd9-9800-c3d708309b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:09.840307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f6868-883b-4cd9-9800-c3d708309b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.840595 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f6868-883b-4cd9-9800-c3d708309b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.841272 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f6868-883b-4cd9-9800-c3d708309b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.842417 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f6868-883b-4cd9-9800-c3d708309b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:09.844383 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f6868-883b-4cd9-9800-c3d708309b37 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:09.866177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1102/2198] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:09.875548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af74332-a85e-46e9-8c34-a62643b470a5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:09.887789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af74332-a85e-46e9-8c34-a62643b470a5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:09.893129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed91292-6fa8-436b-9a97-dbe1cd4aaaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:09.894155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed91292-6fa8-436b-9a97-dbe1cd4aaaba admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.894514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed91292-6fa8-436b-9a97-dbe1cd4aaaba admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.894827 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed91292-6fa8-436b-9a97-dbe1cd4aaaba admin admin] PATH_INFO: `/v3/projects/47cb2c9af150493484862eecca254816/users/ba27642d716c4496b992e112dbd2e22d/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.922709 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed91292-6fa8-436b-9a97-dbe1cd4aaaba admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cb2c9af150493484862eecca254816, user_id=ba27642d716c4496b992e112dbd2e22d, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:09.922709 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed91292-6fa8-436b-9a97-dbe1cd4aaaba admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:09.934811 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1097/2199] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:09 2022] PUT /identity/v3/projects/47cb2c9af150493484862eecca254816/users/ba27642d716c4496b992e112dbd2e22d/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:09.955739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82ba08-9ea9-45e2-b88d-5d88cfe8bcf5 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:09.956022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82ba08-9ea9-45e2-b88d-5d88cfe8bcf5 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:09.956774 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82ba08-9ea9-45e2-b88d-5d88cfe8bcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:09.985965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-5b82ba08-9ea9-45e2-b88d-5d88cfe8bcf5 None None] MFA Rules not processed for user `ba27642d716c4496b992e112dbd2e22d`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:09.987648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5b82ba08-9ea9-45e2-b88d-5d88cfe8bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:10.063830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1103/2200] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:10.069884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed91292-6fa8-436b-9a97-dbe1cd4aaaba admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:10.159455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed91292-6fa8-436b-9a97-dbe1cd4aaaba admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:10.168956 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb96be-9311-4988-b9b6-20dc305f7eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:10.170246 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb96be-9311-4988-b9b6-20dc305f7eca admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:10.171109 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb96be-9311-4988-b9b6-20dc305f7eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:10.172021 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb96be-9311-4988-b9b6-20dc305f7eca admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:10.173006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb96be-9311-4988-b9b6-20dc305f7eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:10.175011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb96be-9311-4988-b9b6-20dc305f7eca admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:10.202907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1098/2201] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:10 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:10.206662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82ba08-9ea9-45e2-b88d-5d88cfe8bcf5 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:10.217115 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82ba08-9ea9-45e2-b88d-5d88cfe8bcf5 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:10.285963 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02d388-bfe6-43a9-af6d-f06b3efc34e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:10.287334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02d388-bfe6-43a9-af6d-f06b3efc34e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:10.287686 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02d388-bfe6-43a9-af6d-f06b3efc34e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:10.288027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02d388-bfe6-43a9-af6d-f06b3efc34e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:10.288785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02d388-bfe6-43a9-af6d-f06b3efc34e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:10.290800 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02d388-bfe6-43a9-af6d-f06b3efc34e0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:10.318365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1104/2202] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:10 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:10.321043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb96be-9311-4988-b9b6-20dc305f7eca admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:10.332975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb96be-9311-4988-b9b6-20dc305f7eca admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:10.337794 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227694b9-740e-437d-9477-72d3d0ba76cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:10.338497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227694b9-740e-437d-9477-72d3d0ba76cf admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:10.338778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227694b9-740e-437d-9477-72d3d0ba76cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:10.339049 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227694b9-740e-437d-9477-72d3d0ba76cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:10.340079 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227694b9-740e-437d-9477-72d3d0ba76cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:10.341392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227694b9-740e-437d-9477-72d3d0ba76cf admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:10.353638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1099/2203] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:10.357966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02d388-bfe6-43a9-af6d-f06b3efc34e0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:10.369393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02d388-bfe6-43a9-af6d-f06b3efc34e0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:10.375167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d684d9-8f7d-4ea2-ab8d-2cebad566a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:10.376598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d684d9-8f7d-4ea2-ab8d-2cebad566a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:10.376878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d684d9-8f7d-4ea2-ab8d-2cebad566a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:10.377285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d684d9-8f7d-4ea2-ab8d-2cebad566a86 admin admin] PATH_INFO: `/v3/projects/0f515f3be8784f3d8f95af183d9ae9d3/users/f2a3a38029a14771b5820e24dfb3b155/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:10.401089 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d684d9-8f7d-4ea2-ab8d-2cebad566a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f515f3be8784f3d8f95af183d9ae9d3, user_id=f2a3a38029a14771b5820e24dfb3b155, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:10.402908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d684d9-8f7d-4ea2-ab8d-2cebad566a86 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:10.422404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1105/2204] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:10 2022] PUT /identity/v3/projects/0f515f3be8784f3d8f95af183d9ae9d3/users/f2a3a38029a14771b5820e24dfb3b155/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:10.426384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227694b9-740e-437d-9477-72d3d0ba76cf admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:10.437396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227694b9-740e-437d-9477-72d3d0ba76cf admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:10.507883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d76313-27fe-41c2-a412-ab48f4d483bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:10.508553 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d76313-27fe-41c2-a412-ab48f4d483bf admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:10.508837 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d76313-27fe-41c2-a412-ab48f4d483bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:10.509114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d76313-27fe-41c2-a412-ab48f4d483bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:10.509852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d76313-27fe-41c2-a412-ab48f4d483bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:10.511497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d76313-27fe-41c2-a412-ab48f4d483bf admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:10.522742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1100/2205] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:39:10.526763 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d684d9-8f7d-4ea2-ab8d-2cebad566a86 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:10.537074 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d684d9-8f7d-4ea2-ab8d-2cebad566a86 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:10.548526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ab479-2017-4506-989a-4b0149c3e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:10.549543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ab479-2017-4506-989a-4b0149c3e1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:10.549849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ab479-2017-4506-989a-4b0149c3e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:10.550183 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ab479-2017-4506-989a-4b0149c3e1e4 admin admin] PATH_INFO: `/v3/projects/0f515f3be8784f3d8f95af183d9ae9d3/users/f2a3a38029a14771b5820e24dfb3b155/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:10.553115 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ab479-2017-4506-989a-4b0149c3e1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f515f3be8784f3d8f95af183d9ae9d3, user_id=f2a3a38029a14771b5820e24dfb3b155, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:10.556114 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ab479-2017-4506-989a-4b0149c3e1e4 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:10.567575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1106/2206] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:10 2022] PUT /identity/v3/projects/0f515f3be8784f3d8f95af183d9ae9d3/users/f2a3a38029a14771b5820e24dfb3b155/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:10.578506 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bea69-5189-4246-8f09-4a5e011fdb47 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:10.578798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bea69-5189-4246-8f09-4a5e011fdb47 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:10.579099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bea69-5189-4246-8f09-4a5e011fdb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:10.620130 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-d02bea69-5189-4246-8f09-4a5e011fdb47 None None] MFA Rules not processed for user `f2a3a38029a14771b5820e24dfb3b155`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:10.621817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d02bea69-5189-4246-8f09-4a5e011fdb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:10.733898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1101/2207] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:10.745474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ab479-2017-4506-989a-4b0149c3e1e4 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:10.748485 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-599ab479-2017-4506-989a-4b0149c3e1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:10.819109 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ab479-2017-4506-989a-4b0149c3e1e4 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:10.823058 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d292bd-a0b6-4c10-8bed-5c5eb551b31c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:10.823712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d292bd-a0b6-4c10-8bed-5c5eb551b31c service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:10.823997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d292bd-a0b6-4c10-8bed-5c5eb551b31c service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:10.824272 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d292bd-a0b6-4c10-8bed-5c5eb551b31c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:10.899624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d292bd-a0b6-4c10-8bed-5c5eb551b31c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:10.908327 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d292bd-a0b6-4c10-8bed-5c5eb551b31c service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:10.915482 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1107/2208] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:12.153660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bea69-5189-4246-8f09-4a5e011fdb47 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:12.156221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d02bea69-5189-4246-8f09-4a5e011fdb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:12.236946 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bea69-5189-4246-8f09-4a5e011fdb47 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:12.241970 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:12.242900 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:12.243476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:12.243714 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] PATH_INFO: `/v3/users/ef3c4b1617bc461b8e4335215349ff92` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:12.249697 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3c4b1617bc461b8e4335215349ff92)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:12.252863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:12.316967 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3c4b1617bc461b8e4335215349ff92'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:12.324838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3c4b1617bc461b8e4335215349ff92'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:12.350665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3c4b1617bc461b8e4335215349ff92'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:12.352156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3c4b1617bc461b8e4335215349ff92'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:12.353023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3c4b1617bc461b8e4335215349ff92'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:12.378720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88676ca3-dba3-4885-917a-184394563086 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:12.379286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88676ca3-dba3-4885-917a-184394563086 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:12.379522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88676ca3-dba3-4885-917a-184394563086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:12.380920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1102/2209] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:12 2022] DELETE /identity/v3/users/ef3c4b1617bc461b8e4335215349ff92 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:12.399107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-88676ca3-dba3-4885-917a-184394563086 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:12.400676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-88676ca3-dba3-4885-917a-184394563086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:12.477493 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:12.479339 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:12.493865 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1108/2210] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:12.504008 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88676ca3-dba3-4885-917a-184394563086 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:12.506598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-88676ca3-dba3-4885-917a-184394563086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:12.583193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5379e-51c1-4a84-8676-8282c1faf0e8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:12.588435 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a4de6-5e1a-444f-838b-2dece30cf6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:12.589381 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a4de6-5e1a-444f-838b-2dece30cf6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:12.590170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a4de6-5e1a-444f-838b-2dece30cf6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:12.590547 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a4de6-5e1a-444f-838b-2dece30cf6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:12.592561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8d7a4de6-5e1a-444f-838b-2dece30cf6a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:12.604205 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88676ca3-dba3-4885-917a-184394563086 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:12.609282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a7a53-8155-431b-b66d-8317370ad6bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:12.610681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a7a53-8155-431b-b66d-8317370ad6bd service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:12.610976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a7a53-8155-431b-b66d-8317370ad6bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:12.611295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a7a53-8155-431b-b66d-8317370ad6bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:12.625468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a7a53-8155-431b-b66d-8317370ad6bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:12.628650 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a7a53-8155-431b-b66d-8317370ad6bd service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:12.654444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1109/2211] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:39:12.698330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a4de6-5e1a-444f-838b-2dece30cf6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:12.700690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a4de6-5e1a-444f-838b-2dece30cf6a1 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:12.715249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1103/2212] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:13.191430 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a7a53-8155-431b-b66d-8317370ad6bd service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:13.193833 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e09a7a53-8155-431b-b66d-8317370ad6bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:13.221390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a7a53-8155-431b-b66d-8317370ad6bd service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:13.227160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:13.228192 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:13.228584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:13.229092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] PATH_INFO: `/v3/projects/3e7af6ba583c4dd1b2fc1ae34a40c00a` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:13.232032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7af6ba583c4dd1b2fc1ae34a40c00a)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:13.234681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:13.306443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7af6ba583c4dd1b2fc1ae34a40c00a', 'request_id': 'req-cd22c561-b5fe-4766-b506-6875afd85ccb'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:13.324792 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7af6ba583c4dd1b2fc1ae34a40c00a', 'request_id': 'req-cd22c561-b5fe-4766-b506-6875afd85ccb'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:13.354879 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7af6ba583c4dd1b2fc1ae34a40c00a', 'request_id': 'req-cd22c561-b5fe-4766-b506-6875afd85ccb'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:13.383132 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] The token cache is being invalidate because project 3e7af6ba583c4dd1b2fc1ae34a40c00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:13.383729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:13.384195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:13.385757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1110/2213] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:13 2022] DELETE /identity/v3/projects/3e7af6ba583c4dd1b2fc1ae34a40c00a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:13.389687 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a4de6-5e1a-444f-838b-2dece30cf6a1 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:13.410892 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a4de6-5e1a-444f-838b-2dece30cf6a1 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:13.496223 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9cf31-6188-452b-a9d2-b7e4ff8e331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:13.500620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9cf31-6188-452b-a9d2-b7e4ff8e331b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:13.500620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9cf31-6188-452b-a9d2-b7e4ff8e331b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:13.500620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9cf31-6188-452b-a9d2-b7e4ff8e331b admin admin] PATH_INFO: `/v3/users/714739a586774053a9a4446326c00830` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:13.500620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9cf31-6188-452b-a9d2-b7e4ff8e331b admin admin] RBAC: Authorizing `identity:delete_user(user_id=714739a586774053a9a4446326c00830)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:13.502425 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9cf31-6188-452b-a9d2-b7e4ff8e331b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:13.550542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:13.555324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:13.589647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-68b9cf31-6188-452b-a9d2-b7e4ff8e331b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714739a586774053a9a4446326c00830'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:13.597501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-68b9cf31-6188-452b-a9d2-b7e4ff8e331b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714739a586774053a9a4446326c00830'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:13.616863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-68b9cf31-6188-452b-a9d2-b7e4ff8e331b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714739a586774053a9a4446326c00830'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:13.617617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-68b9cf31-6188-452b-a9d2-b7e4ff8e331b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714739a586774053a9a4446326c00830'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:13.618618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-68b9cf31-6188-452b-a9d2-b7e4ff8e331b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714739a586774053a9a4446326c00830'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:13.634061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1104/2214] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:13 2022] DELETE /identity/v3/users/714739a586774053a9a4446326c00830 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:13.635494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a29a86-312c-461a-b5ff-25681d3d87f0 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:13.635788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a29a86-312c-461a-b5ff-25681d3d87f0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:13.636066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a29a86-312c-461a-b5ff-25681d3d87f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:13.644976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22c561-b5fe-4766-b506-6875afd85ccb admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:13.680906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-c8a29a86-312c-461a-b5ff-25681d3d87f0 None None] MFA Rules not processed for user `64a37cb9bd2847ee8ec6124cea770c90`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:13.682430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c8a29a86-312c-461a-b5ff-25681d3d87f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:13.712657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6f1c-445a-46a8-9879-d51549997f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:13.713804 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6f1c-445a-46a8-9879-d51549997f8d service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:13.715149 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6f1c-445a-46a8-9879-d51549997f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:13.716018 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6f1c-445a-46a8-9879-d51549997f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:13.719194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a32c6f1c-445a-46a8-9879-d51549997f8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:13.796247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1105/2215] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:13.808179 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e85e2-bd49-412e-96fc-3cc732e82c3a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:13.809263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e85e2-bd49-412e-96fc-3cc732e82c3a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:13.810527 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e85e2-bd49-412e-96fc-3cc732e82c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:13.834862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-806e85e2-bd49-412e-96fc-3cc732e82c3a None None] MFA Rules not processed for user `64a37cb9bd2847ee8ec6124cea770c90`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:13.836287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-806e85e2-bd49-412e-96fc-3cc732e82c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:13.846831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1106/2216] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:13.854903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e85e2-bd49-412e-96fc-3cc732e82c3a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:13.856855 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6f1c-445a-46a8-9879-d51549997f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:13.857172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-806e85e2-bd49-412e-96fc-3cc732e82c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:13.858653 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6f1c-445a-46a8-9879-d51549997f8d service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:13.870158 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1111/2217] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:13.968945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e85e2-bd49-412e-96fc-3cc732e82c3a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:13.975734 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a8fff-d75b-4b50-9064-cf641778bf6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:13.976489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a8fff-d75b-4b50-9064-cf641778bf6b service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:13.976846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a8fff-d75b-4b50-9064-cf641778bf6b service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:13.977241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a8fff-d75b-4b50-9064-cf641778bf6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:13.995269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a8fff-d75b-4b50-9064-cf641778bf6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:13.996928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a8fff-d75b-4b50-9064-cf641778bf6b service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:14.013522 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1107/2218] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:14.060161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6f1c-445a-46a8-9879-d51549997f8d service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:14.061676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a32c6f1c-445a-46a8-9879-d51549997f8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:14.145305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6f1c-445a-46a8-9879-d51549997f8d service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:14.149929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34255f91-00c8-437b-97cd-4427cb355f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:14.150824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255f91-00c8-437b-97cd-4427cb355f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:14.151107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255f91-00c8-437b-97cd-4427cb355f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:14.151381 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255f91-00c8-437b-97cd-4427cb355f94 admin admin] PATH_INFO: `/v3/projects/e6797f34b4504ad1b1bd2824de93040a` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:14.152622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34255f91-00c8-437b-97cd-4427cb355f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6797f34b4504ad1b1bd2824de93040a)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:14.154664 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34255f91-00c8-437b-97cd-4427cb355f94 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:14.205366 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-34255f91-00c8-437b-97cd-4427cb355f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6797f34b4504ad1b1bd2824de93040a', 'request_id': 'req-34255f91-00c8-437b-97cd-4427cb355f94'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:14.210717 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-34255f91-00c8-437b-97cd-4427cb355f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6797f34b4504ad1b1bd2824de93040a', 'request_id': 'req-34255f91-00c8-437b-97cd-4427cb355f94'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:14.217782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-34255f91-00c8-437b-97cd-4427cb355f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6797f34b4504ad1b1bd2824de93040a', 'request_id': 'req-34255f91-00c8-437b-97cd-4427cb355f94'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:14.230007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-34255f91-00c8-437b-97cd-4427cb355f94 admin admin] The token cache is being invalidate because project e6797f34b4504ad1b1bd2824de93040a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:14.230966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-34255f91-00c8-437b-97cd-4427cb355f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:14.231243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-34255f91-00c8-437b-97cd-4427cb355f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:14.232822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1112/2219] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:14 2022] DELETE /identity/v3/projects/e6797f34b4504ad1b1bd2824de93040a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:14.238042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f894-0434-494e-a343-1f4b9c8987da None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:14.238380 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f894-0434-494e-a343-1f4b9c8987da None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:14.238712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f894-0434-494e-a343-1f4b9c8987da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:14.259020 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-c555f894-0434-494e-a343-1f4b9c8987da None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:14.260218 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c555f894-0434-494e-a343-1f4b9c8987da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:14.319509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1108/2220] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:14.325984 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692a101-f941-4277-aeeb-ababc4452c59 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:14.326306 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692a101-f941-4277-aeeb-ababc4452c59 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:14.326587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692a101-f941-4277-aeeb-ababc4452c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:14.345653 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-1692a101-f941-4277-aeeb-ababc4452c59 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:14.346884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1692a101-f941-4277-aeeb-ababc4452c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:14.355931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1113/2221] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:14.360033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555f894-0434-494e-a343-1f4b9c8987da None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:14.370798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555f894-0434-494e-a343-1f4b9c8987da None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:14.379082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961125e9-aa3b-499e-9bc3-805a46aa6426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:14.381468 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961125e9-aa3b-499e-9bc3-805a46aa6426 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:14.382527 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961125e9-aa3b-499e-9bc3-805a46aa6426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:14.383208 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961125e9-aa3b-499e-9bc3-805a46aa6426 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:14.385203 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961125e9-aa3b-499e-9bc3-805a46aa6426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:39:14.386536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961125e9-aa3b-499e-9bc3-805a46aa6426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:14.389688 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961125e9-aa3b-499e-9bc3-805a46aa6426 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:14.405772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1109/2222] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:39:14.410523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692a101-f941-4277-aeeb-ababc4452c59 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:14.419542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692a101-f941-4277-aeeb-ababc4452c59 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:14.424092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d2f17-72be-4158-a489-e8f36f710a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:14.424735 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d2f17-72be-4158-a489-e8f36f710a91 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:14.425015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d2f17-72be-4158-a489-e8f36f710a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:14.425282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d2f17-72be-4158-a489-e8f36f710a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:14.425976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d2f17-72be-4158-a489-e8f36f710a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:14.428668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d2f17-72be-4158-a489-e8f36f710a91 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:14.462243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1114/2223] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:14 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:14.464552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961125e9-aa3b-499e-9bc3-805a46aa6426 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:14.474678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961125e9-aa3b-499e-9bc3-805a46aa6426 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:14.535384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e0888-481c-45bf-9594-e32f5163bd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:14.536090 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e0888-481c-45bf-9594-e32f5163bd12 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:14.536370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e0888-481c-45bf-9594-e32f5163bd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:14.536666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e0888-481c-45bf-9594-e32f5163bd12 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:14.537364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e0888-481c-45bf-9594-e32f5163bd12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:14.539349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e0888-481c-45bf-9594-e32f5163bd12 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:14.561403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1110/2224] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:14 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:14.565523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d2f17-72be-4158-a489-e8f36f710a91 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:14.576815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d2f17-72be-4158-a489-e8f36f710a91 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:14.581559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11ab15-0861-4c83-a14a-3c37655d11b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:14.582252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11ab15-0861-4c83-a14a-3c37655d11b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:14.582538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11ab15-0861-4c83-a14a-3c37655d11b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:14.582821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11ab15-0861-4c83-a14a-3c37655d11b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:14.583557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11ab15-0861-4c83-a14a-3c37655d11b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:14.585168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11ab15-0861-4c83-a14a-3c37655d11b8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:14.596282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1115/2225] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:39:14.600616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e0888-481c-45bf-9594-e32f5163bd12 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:14.616627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e0888-481c-45bf-9594-e32f5163bd12 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:14.624922 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee66e68-436f-47fd-ab66-43f4eb10f5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:14.625938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee66e68-436f-47fd-ab66-43f4eb10f5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:14.626642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee66e68-436f-47fd-ab66-43f4eb10f5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:14.627027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee66e68-436f-47fd-ab66-43f4eb10f5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:14.628151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee66e68-436f-47fd-ab66-43f4eb10f5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:14.631932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee66e68-436f-47fd-ab66-43f4eb10f5e9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:14.641942 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1111/2226] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:14.646116 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11ab15-0861-4c83-a14a-3c37655d11b8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:14.657901 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11ab15-0861-4c83-a14a-3c37655d11b8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:14.664299 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05581a37-98e5-4acc-825d-51bedd48b763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:14.665168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05581a37-98e5-4acc-825d-51bedd48b763 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:14.665448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05581a37-98e5-4acc-825d-51bedd48b763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:14.665724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05581a37-98e5-4acc-825d-51bedd48b763 admin admin] PATH_INFO: `/v3/projects/ab791869a3f347569737c45e4ead6b26/users/ca9ce81829734a89b30e39cd4bffd5e3/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:14.681946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05581a37-98e5-4acc-825d-51bedd48b763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab791869a3f347569737c45e4ead6b26, user_id=ca9ce81829734a89b30e39cd4bffd5e3, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:14.684623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05581a37-98e5-4acc-825d-51bedd48b763 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:14.697830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1116/2227] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:14 2022] PUT /identity/v3/projects/ab791869a3f347569737c45e4ead6b26/users/ca9ce81829734a89b30e39cd4bffd5e3/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:14.708790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8433d4-b7cc-4520-b6cf-e0d568b43cc5 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:14.709079 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8433d4-b7cc-4520-b6cf-e0d568b43cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:14.709356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8433d4-b7cc-4520-b6cf-e0d568b43cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:14.746678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-6d8433d4-b7cc-4520-b6cf-e0d568b43cc5 None None] MFA Rules not processed for user `ca9ce81829734a89b30e39cd4bffd5e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:14.747945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6d8433d4-b7cc-4520-b6cf-e0d568b43cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:14.809514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1112/2228] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:14.819456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05581a37-98e5-4acc-825d-51bedd48b763 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:14.821174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-05581a37-98e5-4acc-825d-51bedd48b763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:14.879956 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05581a37-98e5-4acc-825d-51bedd48b763 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:14.885413 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e1da3-3d57-46a3-acbb-7ef138d4dea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:14.885413 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e1da3-3d57-46a3-acbb-7ef138d4dea6 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:14.885413 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e1da3-3d57-46a3-acbb-7ef138d4dea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:14.885413 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e1da3-3d57-46a3-acbb-7ef138d4dea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:14.893811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e1da3-3d57-46a3-acbb-7ef138d4dea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:14.895274 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e1da3-3d57-46a3-acbb-7ef138d4dea6 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:14.904008 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1117/2229] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:14.924297 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8433d4-b7cc-4520-b6cf-e0d568b43cc5 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:14.998695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8433d4-b7cc-4520-b6cf-e0d568b43cc5 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:15.003436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:15.004307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:15.004590 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:15.004871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] PATH_INFO: `/v3/users/ca9ce81829734a89b30e39cd4bffd5e3` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:15.006145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9ce81829734a89b30e39cd4bffd5e3)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:15.008120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:15.080015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9ce81829734a89b30e39cd4bffd5e3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.087806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9ce81829734a89b30e39cd4bffd5e3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.113910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9ce81829734a89b30e39cd4bffd5e3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.115390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9ce81829734a89b30e39cd4bffd5e3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.115732 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9ce81829734a89b30e39cd4bffd5e3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.133135 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1113/2230] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:14 2022] DELETE /identity/v3/users/ca9ce81829734a89b30e39cd4bffd5e3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:15.137024 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915214d-1b6c-4ddf-8caa-99c1b7838b7d None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:15.137321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915214d-1b6c-4ddf-8caa-99c1b7838b7d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:15.137601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915214d-1b6c-4ddf-8caa-99c1b7838b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:15.155925 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b915214d-1b6c-4ddf-8caa-99c1b7838b7d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:15.157126 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b915214d-1b6c-4ddf-8caa-99c1b7838b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:15.243275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1118/2231] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:15.258245 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:15.258245 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:15.364581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d94168-38dd-47ea-912c-0c57be5ba578 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:15.375925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae1866-41e6-408c-8fe8-4d1cfddf0c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:15.377105 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae1866-41e6-408c-8fe8-4d1cfddf0c77 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:15.377928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae1866-41e6-408c-8fe8-4d1cfddf0c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:15.378239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae1866-41e6-408c-8fe8-4d1cfddf0c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:15.399128 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae1866-41e6-408c-8fe8-4d1cfddf0c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:15.400243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae1866-41e6-408c-8fe8-4d1cfddf0c77 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:15.410506 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1114/2232] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:15.694727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915214d-1b6c-4ddf-8caa-99c1b7838b7d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:15.696183 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b915214d-1b6c-4ddf-8caa-99c1b7838b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:15.709040 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915214d-1b6c-4ddf-8caa-99c1b7838b7d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:15.714546 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe007a9-5058-467c-9c59-4aa7f2b7563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:15.715428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe007a9-5058-467c-9c59-4aa7f2b7563e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:15.715713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe007a9-5058-467c-9c59-4aa7f2b7563e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:15.715990 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe007a9-5058-467c-9c59-4aa7f2b7563e admin admin] PATH_INFO: `/v3/projects/ab791869a3f347569737c45e4ead6b26` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:15.717519 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe007a9-5058-467c-9c59-4aa7f2b7563e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab791869a3f347569737c45e4ead6b26)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:15.719730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe007a9-5058-467c-9c59-4aa7f2b7563e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:15.772835 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9fe007a9-5058-467c-9c59-4aa7f2b7563e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab791869a3f347569737c45e4ead6b26', 'request_id': 'req-9fe007a9-5058-467c-9c59-4aa7f2b7563e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.778477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9fe007a9-5058-467c-9c59-4aa7f2b7563e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab791869a3f347569737c45e4ead6b26', 'request_id': 'req-9fe007a9-5058-467c-9c59-4aa7f2b7563e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.787515 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9fe007a9-5058-467c-9c59-4aa7f2b7563e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab791869a3f347569737c45e4ead6b26', 'request_id': 'req-9fe007a9-5058-467c-9c59-4aa7f2b7563e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.801770 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9fe007a9-5058-467c-9c59-4aa7f2b7563e admin admin] The token cache is being invalidate because project ab791869a3f347569737c45e4ead6b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:15.802861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9fe007a9-5058-467c-9c59-4aa7f2b7563e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.803662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9fe007a9-5058-467c-9c59-4aa7f2b7563e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.805347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1119/2233] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:15 2022] DELETE /identity/v3/projects/ab791869a3f347569737c45e4ead6b26 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:15.810599 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d69f3-73d6-4c24-9d24-9deb22bd22c9 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:15.811266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d69f3-73d6-4c24-9d24-9deb22bd22c9 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:15.811784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d69f3-73d6-4c24-9d24-9deb22bd22c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:15.831114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2c5d69f3-73d6-4c24-9d24-9deb22bd22c9 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:15.832420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2c5d69f3-73d6-4c24-9d24-9deb22bd22c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:15.891705 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1115/2234] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:15.900013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd5da-2a38-41e9-bfad-4a0b42d413aa None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:15.900302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd5da-2a38-41e9-bfad-4a0b42d413aa None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:15.900576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd5da-2a38-41e9-bfad-4a0b42d413aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:15.919478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-cc9cd5da-2a38-41e9-bfad-4a0b42d413aa None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:15.920691 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-cc9cd5da-2a38-41e9-bfad-4a0b42d413aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:15.929186 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1120/2235] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:15.933489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d69f3-73d6-4c24-9d24-9deb22bd22c9 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:15.944506 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d69f3-73d6-4c24-9d24-9deb22bd22c9 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:15.949801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6221e70-def2-402d-832f-b72b437c5fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:15.950749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6221e70-def2-402d-832f-b72b437c5fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:15.951039 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6221e70-def2-402d-832f-b72b437c5fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:15.951315 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6221e70-def2-402d-832f-b72b437c5fe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:15.952204 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6221e70-def2-402d-832f-b72b437c5fe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:39:15.952523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6221e70-def2-402d-832f-b72b437c5fe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:15.954486 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6221e70-def2-402d-832f-b72b437c5fe2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:15.971323 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1116/2236] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:39:15.976060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd5da-2a38-41e9-bfad-4a0b42d413aa None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:15.985175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd5da-2a38-41e9-bfad-4a0b42d413aa None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:15.990194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c849007-a8db-4b91-be0e-dcbb018abee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:15.990874 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c849007-a8db-4b91-be0e-dcbb018abee7 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:15.991493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c849007-a8db-4b91-be0e-dcbb018abee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:15.991839 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c849007-a8db-4b91-be0e-dcbb018abee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:15.992603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c849007-a8db-4b91-be0e-dcbb018abee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:15.995167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c849007-a8db-4b91-be0e-dcbb018abee7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:16.024145 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1121/2237] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:15 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:16.028515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6221e70-def2-402d-832f-b72b437c5fe2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:16.040738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6221e70-def2-402d-832f-b72b437c5fe2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:16.109005 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d76023-43f2-48f9-8132-2a92ebf73efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:16.109690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d76023-43f2-48f9-8132-2a92ebf73efc admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:16.109992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d76023-43f2-48f9-8132-2a92ebf73efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:16.110433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d76023-43f2-48f9-8132-2a92ebf73efc admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:16.111519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d76023-43f2-48f9-8132-2a92ebf73efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:16.113645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d76023-43f2-48f9-8132-2a92ebf73efc admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:16.136114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1117/2238] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:16 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:16.140301 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c849007-a8db-4b91-be0e-dcbb018abee7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:16.151476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c849007-a8db-4b91-be0e-dcbb018abee7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:16.156529 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f880fa-55b5-4190-9d7b-a30c6c61ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:16.157212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f880fa-55b5-4190-9d7b-a30c6c61ec45 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:16.157772 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f880fa-55b5-4190-9d7b-a30c6c61ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:16.158054 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f880fa-55b5-4190-9d7b-a30c6c61ec45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:16.158837 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f880fa-55b5-4190-9d7b-a30c6c61ec45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:16.160633 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f880fa-55b5-4190-9d7b-a30c6c61ec45 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:16.177417 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1122/2239] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:16.178797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d76023-43f2-48f9-8132-2a92ebf73efc admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:16.193160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d76023-43f2-48f9-8132-2a92ebf73efc admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:16.204799 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e6f34-8dbc-48d6-baad-977a022c714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:16.205932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e6f34-8dbc-48d6-baad-977a022c714a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:16.206311 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e6f34-8dbc-48d6-baad-977a022c714a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:16.206656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e6f34-8dbc-48d6-baad-977a022c714a admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:16.207467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e6f34-8dbc-48d6-baad-977a022c714a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:16.209782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e6f34-8dbc-48d6-baad-977a022c714a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:16.223310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1118/2240] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:39:16.227712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f880fa-55b5-4190-9d7b-a30c6c61ec45 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:16.238859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f880fa-55b5-4190-9d7b-a30c6c61ec45 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:16.244365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f31173-45e9-4174-a113-02302d855143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:16.245323 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f31173-45e9-4174-a113-02302d855143 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:16.245669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f31173-45e9-4174-a113-02302d855143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:16.246012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f31173-45e9-4174-a113-02302d855143 admin admin] PATH_INFO: `/v3/projects/8d55ff8f89dd4efe91ad4e0f863808ee/users/c5792618a1d24270bce56d7b288b3896/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:16.268014 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f31173-45e9-4174-a113-02302d855143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d55ff8f89dd4efe91ad4e0f863808ee, user_id=c5792618a1d24270bce56d7b288b3896, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:16.272330 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f31173-45e9-4174-a113-02302d855143 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:16.289917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1123/2241] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:16 2022] PUT /identity/v3/projects/8d55ff8f89dd4efe91ad4e0f863808ee/users/c5792618a1d24270bce56d7b288b3896/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:16.294596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d5ce9-7258-4b38-a595-e0c2ab021ace None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:16.294887 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d5ce9-7258-4b38-a595-e0c2ab021ace None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:16.295167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d5ce9-7258-4b38-a595-e0c2ab021ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:16.315893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-5c7d5ce9-7258-4b38-a595-e0c2ab021ace None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:16.317153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5c7d5ce9-7258-4b38-a595-e0c2ab021ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:16.382256 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1119/2242] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:16.391023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f31173-45e9-4174-a113-02302d855143 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:16.392928 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-62f31173-45e9-4174-a113-02302d855143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:16.466500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f31173-45e9-4174-a113-02302d855143 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:16.470379 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b6cf6-11e6-4758-9baa-f3a089c70ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:16.471037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b6cf6-11e6-4758-9baa-f3a089c70ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:16.471324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b6cf6-11e6-4758-9baa-f3a089c70ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:16.471600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b6cf6-11e6-4758-9baa-f3a089c70ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:16.483107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b6cf6-11e6-4758-9baa-f3a089c70ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:16.484544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b6cf6-11e6-4758-9baa-f3a089c70ed1 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:16.500666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1124/2243] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:17.276190 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029365f-782f-4b60-9c15-fcfacc6a1e47 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:17.276693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029365f-782f-4b60-9c15-fcfacc6a1e47 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:17.276789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029365f-782f-4b60-9c15-fcfacc6a1e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:17.311260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-d029365f-782f-4b60-9c15-fcfacc6a1e47 None None] MFA Rules not processed for user `c5792618a1d24270bce56d7b288b3896`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:17.312469 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d029365f-782f-4b60-9c15-fcfacc6a1e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:17.388915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1120/2244] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:17.397973 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b6cf6-11e6-4758-9baa-f3a089c70ed1 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:17.399543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1f3b6cf6-11e6-4758-9baa-f3a089c70ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:17.467509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b6cf6-11e6-4758-9baa-f3a089c70ed1 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:17.471917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69490e6d-f59f-4855-b48b-00f10b4857c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:17.472732 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69490e6d-f59f-4855-b48b-00f10b4857c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:17.473018 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69490e6d-f59f-4855-b48b-00f10b4857c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:17.473339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69490e6d-f59f-4855-b48b-00f10b4857c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:17.482809 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69490e6d-f59f-4855-b48b-00f10b4857c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:17.484479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69490e6d-f59f-4855-b48b-00f10b4857c0 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:17.497462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1125/2245] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:17.921705 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029365f-782f-4b60-9c15-fcfacc6a1e47 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:17.923219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d029365f-782f-4b60-9c15-fcfacc6a1e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:17.936760 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029365f-782f-4b60-9c15-fcfacc6a1e47 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:17.941245 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:17.942110 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:17.942437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:17.942742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] PATH_INFO: `/v3/users/11f3030c009a45a2b81581db9fd3851c` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:17.943960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f3030c009a45a2b81581db9fd3851c)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:17.946366 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:17.994679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f3030c009a45a2b81581db9fd3851c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:18.002188 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f3030c009a45a2b81581db9fd3851c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:18.013991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f3030c009a45a2b81581db9fd3851c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:18.014718 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f3030c009a45a2b81581db9fd3851c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:18.015340 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f3030c009a45a2b81581db9fd3851c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:18.029843 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1121/2246] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:17 2022] DELETE /identity/v3/users/11f3030c009a45a2b81581db9fd3851c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:18.034565 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb91ed8-9bfc-474d-b915-fa76065b3584 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:18.034950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb91ed8-9bfc-474d-b915-fa76065b3584 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:18.035338 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb91ed8-9bfc-474d-b915-fa76065b3584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:18.068297 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-fdb91ed8-9bfc-474d-b915-fa76065b3584 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:18.069986 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fdb91ed8-9bfc-474d-b915-fa76065b3584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:18.154666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1126/2247] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:18.165136 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:18.166809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:18.243861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265be3ac-01c7-43cd-88b5-d4378f0fba3d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:18.252068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fb0cc-2582-448a-b7ec-2cb000426894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:18.252758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fb0cc-2582-448a-b7ec-2cb000426894 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:18.253129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fb0cc-2582-448a-b7ec-2cb000426894 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:18.253352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fb0cc-2582-448a-b7ec-2cb000426894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:18.272756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fb0cc-2582-448a-b7ec-2cb000426894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:18.275837 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fb0cc-2582-448a-b7ec-2cb000426894 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:18.301502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1122/2248] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:18.565425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dc458-2ecb-40ea-9439-8e3e0efa4086 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:18.565941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dc458-2ecb-40ea-9439-8e3e0efa4086 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:18.566024 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dc458-2ecb-40ea-9439-8e3e0efa4086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:18.591697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-e06dc458-2ecb-40ea-9439-8e3e0efa4086 None None] MFA Rules not processed for user `64a37cb9bd2847ee8ec6124cea770c90`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:18.593161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e06dc458-2ecb-40ea-9439-8e3e0efa4086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:18.674598 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fb0cc-2582-448a-b7ec-2cb000426894 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:18.676865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-bb1fb0cc-2582-448a-b7ec-2cb000426894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:18.678943 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1127/2249] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:18.701749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fb0cc-2582-448a-b7ec-2cb000426894 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:18.709121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:18.710342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:18.710957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:18.711425 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b admin admin] PATH_INFO: `/v3/projects/7b3173ba0ddf495fbe475a5b657f9e8b` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:18.712991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3173ba0ddf495fbe475a5b657f9e8b)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:18.716560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:18.779494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3173ba0ddf495fbe475a5b657f9e8b', 'request_id': 'req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:18.786440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3173ba0ddf495fbe475a5b657f9e8b', 'request_id': 'req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:18.794487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3173ba0ddf495fbe475a5b657f9e8b', 'request_id': 'req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:18.807038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b admin admin] The token cache is being invalidate because project 7b3173ba0ddf495fbe475a5b657f9e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:18.807332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:18.809441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c6cacbe9-06ad-4b4c-bbed-ca146d65b39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:18.811243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1123/2250] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:18 2022] DELETE /identity/v3/projects/7b3173ba0ddf495fbe475a5b657f9e8b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:18.815315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dc458-2ecb-40ea-9439-8e3e0efa4086 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:18.828482 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dc458-2ecb-40ea-9439-8e3e0efa4086 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:18.874880 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb67db-cf28-411c-9921-f7b0f1a8a719 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:18.875433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb67db-cf28-411c-9921-f7b0f1a8a719 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:18.875713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb67db-cf28-411c-9921-f7b0f1a8a719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:18.894743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-60eb67db-cf28-411c-9921-f7b0f1a8a719 None None] MFA Rules not processed for user `c5792618a1d24270bce56d7b288b3896`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:18.895976 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-60eb67db-cf28-411c-9921-f7b0f1a8a719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:18.909548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:18.910580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:18.910894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:18.911137 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] PATH_INFO: `/v3/users/ba27642d716c4496b992e112dbd2e22d` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:18.912445 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba27642d716c4496b992e112dbd2e22d)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:18.914679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:18.963470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1124/2251] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:18.972029 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba27642d716c4496b992e112dbd2e22d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:18.986708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba27642d716c4496b992e112dbd2e22d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.001062 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba27642d716c4496b992e112dbd2e22d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.002150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba27642d716c4496b992e112dbd2e22d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.009868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba27642d716c4496b992e112dbd2e22d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.027219 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1128/2252] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:18 2022] DELETE /identity/v3/users/ba27642d716c4496b992e112dbd2e22d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:19.329206 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb67db-cf28-411c-9921-f7b0f1a8a719 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:19.329853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-60eb67db-cf28-411c-9921-f7b0f1a8a719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:19.354058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb67db-cf28-411c-9921-f7b0f1a8a719 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:19.416531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:19.417389 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:19.417674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:19.417975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] PATH_INFO: `/v3/projects/47cb2c9af150493484862eecca254816` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:19.419252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] RBAC: Authorizing `identity:delete_project(project_id=47cb2c9af150493484862eecca254816)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:19.421217 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:19.467724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cb2c9af150493484862eecca254816', 'request_id': 'req-0d629638-525f-4c33-bb98-b1693256f50a'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.475131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cb2c9af150493484862eecca254816', 'request_id': 'req-0d629638-525f-4c33-bb98-b1693256f50a'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.482436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cb2c9af150493484862eecca254816', 'request_id': 'req-0d629638-525f-4c33-bb98-b1693256f50a'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.493743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] The token cache is being invalidate because project 47cb2c9af150493484862eecca254816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:19.494019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.494662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.496194 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1125/2253] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:19 2022] DELETE /identity/v3/projects/47cb2c9af150493484862eecca254816 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:19.500184 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:19.501619 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:19.514695 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83fbd7-9ebd-49fe-8daf-94c69b2192c1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:19.580251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d831d-22d9-40fa-9f15-bee2b737190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:19.581173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d831d-22d9-40fa-9f15-bee2b737190a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:19.581461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d831d-22d9-40fa-9f15-bee2b737190a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:19.581733 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d831d-22d9-40fa-9f15-bee2b737190a admin admin] PATH_INFO: `/v3/users/f2a3a38029a14771b5820e24dfb3b155` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:19.582975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d831d-22d9-40fa-9f15-bee2b737190a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a3a38029a14771b5820e24dfb3b155)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:19.584963 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d831d-22d9-40fa-9f15-bee2b737190a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:19.642438 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-da6d831d-22d9-40fa-9f15-bee2b737190a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a3a38029a14771b5820e24dfb3b155'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.651721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-da6d831d-22d9-40fa-9f15-bee2b737190a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a3a38029a14771b5820e24dfb3b155'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.667011 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-da6d831d-22d9-40fa-9f15-bee2b737190a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a3a38029a14771b5820e24dfb3b155'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.668913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-da6d831d-22d9-40fa-9f15-bee2b737190a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a3a38029a14771b5820e24dfb3b155'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.679291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-da6d831d-22d9-40fa-9f15-bee2b737190a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a3a38029a14771b5820e24dfb3b155'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:19.691153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1129/2254] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:19 2022] DELETE /identity/v3/users/f2a3a38029a14771b5820e24dfb3b155 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:20.283473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:20.285065 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:20.336458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d629638-525f-4c33-bb98-b1693256f50a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:20.436929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53602f93-754c-4146-9503-8edd982c80ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:20.439575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53602f93-754c-4146-9503-8edd982c80ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:20.440759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53602f93-754c-4146-9503-8edd982c80ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:20.441286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53602f93-754c-4146-9503-8edd982c80ca admin admin] PATH_INFO: `/v3/projects/0f515f3be8784f3d8f95af183d9ae9d3` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:20.444662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53602f93-754c-4146-9503-8edd982c80ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f515f3be8784f3d8f95af183d9ae9d3)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:20.449040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53602f93-754c-4146-9503-8edd982c80ca admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:20.536867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-53602f93-754c-4146-9503-8edd982c80ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f515f3be8784f3d8f95af183d9ae9d3', 'request_id': 'req-53602f93-754c-4146-9503-8edd982c80ca'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:20.546232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-53602f93-754c-4146-9503-8edd982c80ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f515f3be8784f3d8f95af183d9ae9d3', 'request_id': 'req-53602f93-754c-4146-9503-8edd982c80ca'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:20.557457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-53602f93-754c-4146-9503-8edd982c80ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f515f3be8784f3d8f95af183d9ae9d3', 'request_id': 'req-53602f93-754c-4146-9503-8edd982c80ca'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:20.572480 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-53602f93-754c-4146-9503-8edd982c80ca admin admin] The token cache is being invalidate because project 0f515f3be8784f3d8f95af183d9ae9d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:20.572927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-53602f93-754c-4146-9503-8edd982c80ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:20.574105 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-53602f93-754c-4146-9503-8edd982c80ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:20.579426 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1126/2255] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:20 2022] DELETE /identity/v3/projects/0f515f3be8784f3d8f95af183d9ae9d3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:20.581129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6525-4e8a-4ee2-99f4-33b885d7ec90 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:20.581583 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6525-4e8a-4ee2-99f4-33b885d7ec90 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:20.586808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6525-4e8a-4ee2-99f4-33b885d7ec90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:20.616247 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-f08d6525-4e8a-4ee2-99f4-33b885d7ec90 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:20.618260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f08d6525-4e8a-4ee2-99f4-33b885d7ec90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:20.694543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1130/2256] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:20.702558 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb853a2-c6ca-4966-a4b2-0e5f0495ad3f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:20.702920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb853a2-c6ca-4966-a4b2-0e5f0495ad3f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:20.703210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb853a2-c6ca-4966-a4b2-0e5f0495ad3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:20.736058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0cb853a2-c6ca-4966-a4b2-0e5f0495ad3f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:20.737591 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0cb853a2-c6ca-4966-a4b2-0e5f0495ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:20.747934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1127/2257] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:20.757204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d6525-4e8a-4ee2-99f4-33b885d7ec90 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:20.769362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d6525-4e8a-4ee2-99f4-33b885d7ec90 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:20.774996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc7cdd-9649-4e46-87b9-90c2d1f6394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:20.775748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc7cdd-9649-4e46-87b9-90c2d1f6394b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:20.776228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc7cdd-9649-4e46-87b9-90c2d1f6394b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:20.776577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc7cdd-9649-4e46-87b9-90c2d1f6394b admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:20.777392 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc7cdd-9649-4e46-87b9-90c2d1f6394b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:39:20.777861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc7cdd-9649-4e46-87b9-90c2d1f6394b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:20.779650 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc7cdd-9649-4e46-87b9-90c2d1f6394b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:20.793089 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1131/2258] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:39:20.797687 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb853a2-c6ca-4966-a4b2-0e5f0495ad3f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:20.808838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb853a2-c6ca-4966-a4b2-0e5f0495ad3f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:20.814745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de7564-6bb8-483e-b893-066a8031498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:20.815688 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7564-6bb8-483e-b893-066a8031498b admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:20.815974 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7564-6bb8-483e-b893-066a8031498b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:20.816240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7564-6bb8-483e-b893-066a8031498b admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:20.817080 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de7564-6bb8-483e-b893-066a8031498b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:20.819341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de7564-6bb8-483e-b893-066a8031498b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:20.853571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1128/2259] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:20 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:20.854909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc7cdd-9649-4e46-87b9-90c2d1f6394b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:20.877154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc7cdd-9649-4e46-87b9-90c2d1f6394b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:20.949454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45bbc-cb59-4e23-a1d7-8229c90c969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:20.958006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45bbc-cb59-4e23-a1d7-8229c90c969a admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:20.959389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45bbc-cb59-4e23-a1d7-8229c90c969a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:20.959925 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45bbc-cb59-4e23-a1d7-8229c90c969a admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:20.961084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe45bbc-cb59-4e23-a1d7-8229c90c969a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:20.966759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe45bbc-cb59-4e23-a1d7-8229c90c969a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:20.999778 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1132/2260] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:20 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:21.004249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de7564-6bb8-483e-b893-066a8031498b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:21.017474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de7564-6bb8-483e-b893-066a8031498b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:21.024168 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285b9d-f9af-447c-9780-983fd8050013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:21.025144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285b9d-f9af-447c-9780-983fd8050013 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:21.025598 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285b9d-f9af-447c-9780-983fd8050013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:21.026075 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285b9d-f9af-447c-9780-983fd8050013 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:21.027035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d285b9d-f9af-447c-9780-983fd8050013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:21.029067 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d285b9d-f9af-447c-9780-983fd8050013 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:21.042941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1129/2261] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:21.051337 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45bbc-cb59-4e23-a1d7-8229c90c969a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:21.064322 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45bbc-cb59-4e23-a1d7-8229c90c969a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:21.072854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fca92-ac8b-45e9-bbe8-69b0e32cc9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:21.073541 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fca92-ac8b-45e9-bbe8-69b0e32cc9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:21.074535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fca92-ac8b-45e9-bbe8-69b0e32cc9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:21.074815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fca92-ac8b-45e9-bbe8-69b0e32cc9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:21.075715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fca92-ac8b-45e9-bbe8-69b0e32cc9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:21.078559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fca92-ac8b-45e9-bbe8-69b0e32cc9f7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:21.097302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1133/2262] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:39:21.100538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285b9d-f9af-447c-9780-983fd8050013 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:21.113894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285b9d-f9af-447c-9780-983fd8050013 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:21.125542 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc030c-644c-440f-bd05-e31972e9e511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:21.126917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc030c-644c-440f-bd05-e31972e9e511 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:21.127354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc030c-644c-440f-bd05-e31972e9e511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:21.127791 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc030c-644c-440f-bd05-e31972e9e511 admin admin] PATH_INFO: `/v3/projects/7a916e47ab8d415c859be228952f126e/users/54e1356607d249539e4dc8f96fb774d9/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:21.156780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc030c-644c-440f-bd05-e31972e9e511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a916e47ab8d415c859be228952f126e, user_id=54e1356607d249539e4dc8f96fb774d9, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:21.164560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc030c-644c-440f-bd05-e31972e9e511 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:21.189872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1130/2263] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:21 2022] PUT /identity/v3/projects/7a916e47ab8d415c859be228952f126e/users/54e1356607d249539e4dc8f96fb774d9/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:21.202320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b921ea-f42f-477e-85c8-904162d1a786 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:21.202645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b921ea-f42f-477e-85c8-904162d1a786 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:21.202925 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b921ea-f42f-477e-85c8-904162d1a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:21.245913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c8b921ea-f42f-477e-85c8-904162d1a786 None None] MFA Rules not processed for user `54e1356607d249539e4dc8f96fb774d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:21.247279 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c8b921ea-f42f-477e-85c8-904162d1a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:21.405799 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1134/2264] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:21.424160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc030c-644c-440f-bd05-e31972e9e511 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:21.425888 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f7fc030c-644c-440f-bd05-e31972e9e511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:21.497015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc030c-644c-440f-bd05-e31972e9e511 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:21.500831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97938d80-7963-4b16-b24b-0c3dc9b6ba50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:21.501666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97938d80-7963-4b16-b24b-0c3dc9b6ba50 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:21.501941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97938d80-7963-4b16-b24b-0c3dc9b6ba50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:21.502607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97938d80-7963-4b16-b24b-0c3dc9b6ba50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:21.511977 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97938d80-7963-4b16-b24b-0c3dc9b6ba50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:21.513411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97938d80-7963-4b16-b24b-0c3dc9b6ba50 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:21.525179 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1131/2265] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:41.185496 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b921ea-f42f-477e-85c8-904162d1a786 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:41.297004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b921ea-f42f-477e-85c8-904162d1a786 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:41.304521 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:41.307200 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:41.307431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:41.309003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] PATH_INFO: `/v3/users/54e1356607d249539e4dc8f96fb774d9` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:41.315107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e1356607d249539e4dc8f96fb774d9)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:41.317178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:41.382470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e1356607d249539e4dc8f96fb774d9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:41.390357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e1356607d249539e4dc8f96fb774d9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:41.404265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e1356607d249539e4dc8f96fb774d9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:41.404954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e1356607d249539e4dc8f96fb774d9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:41.412384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e1356607d249539e4dc8f96fb774d9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:41.418224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1135/2266] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:41 2022] DELETE /identity/v3/users/54e1356607d249539e4dc8f96fb774d9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:41.422854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a89f2c-7ec6-4a22-b99b-75e7723458f8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:41.423833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a89f2c-7ec6-4a22-b99b-75e7723458f8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:41.424772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a89f2c-7ec6-4a22-b99b-75e7723458f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:41.443777 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-d0a89f2c-7ec6-4a22-b99b-75e7723458f8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:41.445086 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d0a89f2c-7ec6-4a22-b99b-75e7723458f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:41.511492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1132/2267] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:41.522934 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:41.524378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:41.586332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747fcee-210f-49a2-af8f-b304a34fc741 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:41.589949 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd893f3f-ebcb-45ab-9d89-ecf818c0ae23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:41.590748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd893f3f-ebcb-45ab-9d89-ecf818c0ae23 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:41.591031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd893f3f-ebcb-45ab-9d89-ecf818c0ae23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:41.591303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd893f3f-ebcb-45ab-9d89-ecf818c0ae23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:41.602526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd893f3f-ebcb-45ab-9d89-ecf818c0ae23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:41.604016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd893f3f-ebcb-45ab-9d89-ecf818c0ae23 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:41.618070 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1136/2268] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:42.151124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a89f2c-7ec6-4a22-b99b-75e7723458f8 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:42.152517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d0a89f2c-7ec6-4a22-b99b-75e7723458f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:42.168082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a89f2c-7ec6-4a22-b99b-75e7723458f8 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:42.173931 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a90f41-5e35-457c-8077-52eba77c214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:42.174823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a90f41-5e35-457c-8077-52eba77c214c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:42.175100 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a90f41-5e35-457c-8077-52eba77c214c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:42.175396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a90f41-5e35-457c-8077-52eba77c214c admin admin] PATH_INFO: `/v3/projects/7a916e47ab8d415c859be228952f126e` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:42.176597 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a90f41-5e35-457c-8077-52eba77c214c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a916e47ab8d415c859be228952f126e)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:42.179576 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a90f41-5e35-457c-8077-52eba77c214c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:42.223689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-72a90f41-5e35-457c-8077-52eba77c214c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a916e47ab8d415c859be228952f126e', 'request_id': 'req-72a90f41-5e35-457c-8077-52eba77c214c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:42.230537 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-72a90f41-5e35-457c-8077-52eba77c214c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a916e47ab8d415c859be228952f126e', 'request_id': 'req-72a90f41-5e35-457c-8077-52eba77c214c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:42.240198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-72a90f41-5e35-457c-8077-52eba77c214c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a916e47ab8d415c859be228952f126e', 'request_id': 'req-72a90f41-5e35-457c-8077-52eba77c214c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:42.251356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-72a90f41-5e35-457c-8077-52eba77c214c admin admin] The token cache is being invalidate because project 7a916e47ab8d415c859be228952f126e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:42.251649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-72a90f41-5e35-457c-8077-52eba77c214c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:42.252285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-72a90f41-5e35-457c-8077-52eba77c214c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:42.253822 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1133/2269] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:42 2022] DELETE /identity/v3/projects/7a916e47ab8d415c859be228952f126e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:42.259474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339e7f1-f7da-4bfe-bd54-1cb85c8fbf60 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:42.259944 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339e7f1-f7da-4bfe-bd54-1cb85c8fbf60 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:42.260177 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339e7f1-f7da-4bfe-bd54-1cb85c8fbf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:42.278176 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-5339e7f1-f7da-4bfe-bd54-1cb85c8fbf60 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:42.279399 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5339e7f1-f7da-4bfe-bd54-1cb85c8fbf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:42.337085 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1137/2270] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:42.344430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acc3c0-9307-4056-91f1-c3d6b85a1f87 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:42.344720 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acc3c0-9307-4056-91f1-c3d6b85a1f87 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:42.345004 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acc3c0-9307-4056-91f1-c3d6b85a1f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:42.365566 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e1acc3c0-9307-4056-91f1-c3d6b85a1f87 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:42.366928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e1acc3c0-9307-4056-91f1-c3d6b85a1f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:42.378099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1134/2271] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:42.383326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339e7f1-f7da-4bfe-bd54-1cb85c8fbf60 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:42.392976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339e7f1-f7da-4bfe-bd54-1cb85c8fbf60 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:42.397667 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059f330-8342-4246-825a-9471e1bab5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:42.398345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059f330-8342-4246-825a-9471e1bab5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:42.398631 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059f330-8342-4246-825a-9471e1bab5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:42.398903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059f330-8342-4246-825a-9471e1bab5e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:42.399695 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059f330-8342-4246-825a-9471e1bab5e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:39:42.400015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059f330-8342-4246-825a-9471e1bab5e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:42.401715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059f330-8342-4246-825a-9471e1bab5e9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:42.414883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1138/2272] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:39:42.419310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acc3c0-9307-4056-91f1-c3d6b85a1f87 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:42.430772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acc3c0-9307-4056-91f1-c3d6b85a1f87 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:42.435420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17077608-c95c-4a51-a563-a4fc7cc1c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:42.436072 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17077608-c95c-4a51-a563-a4fc7cc1c636 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:42.436355 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17077608-c95c-4a51-a563-a4fc7cc1c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:42.436737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17077608-c95c-4a51-a563-a4fc7cc1c636 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:42.437428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17077608-c95c-4a51-a563-a4fc7cc1c636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:42.439420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17077608-c95c-4a51-a563-a4fc7cc1c636 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:42.465025 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1135/2273] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:42 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:42.469139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059f330-8342-4246-825a-9471e1bab5e9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:42.479603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059f330-8342-4246-825a-9471e1bab5e9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:42.534574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175362f-d886-44e4-a4ed-034f88fa1836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:42.535229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175362f-d886-44e4-a4ed-034f88fa1836 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:42.535508 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175362f-d886-44e4-a4ed-034f88fa1836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:42.535775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175362f-d886-44e4-a4ed-034f88fa1836 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:42.536462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175362f-d886-44e4-a4ed-034f88fa1836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:42.538955 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175362f-d886-44e4-a4ed-034f88fa1836 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:42.557235 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1139/2274] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:42 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:42.561240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17077608-c95c-4a51-a563-a4fc7cc1c636 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:42.571271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17077608-c95c-4a51-a563-a4fc7cc1c636 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:42.575996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f2411-d820-4b0a-947e-c1a54249c9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:42.576647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f2411-d820-4b0a-947e-c1a54249c9ea admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:42.576924 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f2411-d820-4b0a-947e-c1a54249c9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:42.577192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f2411-d820-4b0a-947e-c1a54249c9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:42.577916 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f2411-d820-4b0a-947e-c1a54249c9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:42.579561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f2411-d820-4b0a-947e-c1a54249c9ea admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:42.589602 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1136/2275] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:42.593169 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175362f-d886-44e4-a4ed-034f88fa1836 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:42.603052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175362f-d886-44e4-a4ed-034f88fa1836 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:42.607574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e9cb7-bdf4-4273-b3ca-9975e8643537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:42.608209 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e9cb7-bdf4-4273-b3ca-9975e8643537 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:42.608487 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e9cb7-bdf4-4273-b3ca-9975e8643537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:42.608757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e9cb7-bdf4-4273-b3ca-9975e8643537 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:42.609470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e9cb7-bdf4-4273-b3ca-9975e8643537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:42.611092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e9cb7-bdf4-4273-b3ca-9975e8643537 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:42.621282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1140/2276] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:42.625019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f2411-d820-4b0a-947e-c1a54249c9ea admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:42.634498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f2411-d820-4b0a-947e-c1a54249c9ea admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:42.638989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f9e8f-76f9-4f09-babd-a793424caeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:42.639848 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f9e8f-76f9-4f09-babd-a793424caeaa admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:42.640125 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f9e8f-76f9-4f09-babd-a793424caeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:42.640395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f9e8f-76f9-4f09-babd-a793424caeaa admin admin] PATH_INFO: `/v3/projects/8a01e8a980fc419f88335882f4f61612/users/0d6b8346f8144ec4bebdadd1e5572317/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:42.653961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f9e8f-76f9-4f09-babd-a793424caeaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a01e8a980fc419f88335882f4f61612, user_id=0d6b8346f8144ec4bebdadd1e5572317, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:42.657198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f9e8f-76f9-4f09-babd-a793424caeaa admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:42.669754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1137/2277] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:42 2022] PUT /identity/v3/projects/8a01e8a980fc419f88335882f4f61612/users/0d6b8346f8144ec4bebdadd1e5572317/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:39:42.674748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2002d-babd-4060-be8b-371c844be4d6 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:42.675037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2002d-babd-4060-be8b-371c844be4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:42.675343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2002d-babd-4060-be8b-371c844be4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:42.693052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-01e2002d-babd-4060-be8b-371c844be4d6 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:42.694260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-01e2002d-babd-4060-be8b-371c844be4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:42.750898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1141/2278] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:42.760369 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f9e8f-76f9-4f09-babd-a793424caeaa admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:42.762061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ac2f9e8f-76f9-4f09-babd-a793424caeaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:42.815994 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f9e8f-76f9-4f09-babd-a793424caeaa admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:42.819847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab023e-8ccb-4ab7-b51e-fe3846fcd61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:42.820487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab023e-8ccb-4ab7-b51e-fe3846fcd61e service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:42.820766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab023e-8ccb-4ab7-b51e-fe3846fcd61e service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:42.821035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab023e-8ccb-4ab7-b51e-fe3846fcd61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:42.829854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab023e-8ccb-4ab7-b51e-fe3846fcd61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:42.831308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab023e-8ccb-4ab7-b51e-fe3846fcd61e service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:42.840904 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1138/2279] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:45.644893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a4a7b-f5cb-45b5-a5c2-a789031a3c43 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:45.645703 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a4a7b-f5cb-45b5-a5c2-a789031a3c43 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:45.646248 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a4a7b-f5cb-45b5-a5c2-a789031a3c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:45.673854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b48a4a7b-f5cb-45b5-a5c2-a789031a3c43 None None] MFA Rules not processed for user `c5792618a1d24270bce56d7b288b3896`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:45.677587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b48a4a7b-f5cb-45b5-a5c2-a789031a3c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:45.767434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1142/2280] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:46.914716 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab023e-8ccb-4ab7-b51e-fe3846fcd61e service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:46.917056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-30ab023e-8ccb-4ab7-b51e-fe3846fcd61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:46.958953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab023e-8ccb-4ab7-b51e-fe3846fcd61e service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:46.984910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:46.989042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:46.992066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:46.992416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] PATH_INFO: `/v3/users/f82ae2fa9f3340d6870468b94ac79bba` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:46.995033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82ae2fa9f3340d6870468b94ac79bba)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:46.999926 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:47.149973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82ae2fa9f3340d6870468b94ac79bba'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:47.168047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82ae2fa9f3340d6870468b94ac79bba'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:47.187433 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82ae2fa9f3340d6870468b94ac79bba'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:47.188614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82ae2fa9f3340d6870468b94ac79bba'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:47.204956 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82ae2fa9f3340d6870468b94ac79bba'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:47.234854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1139/2281] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:46 2022] DELETE /identity/v3/users/f82ae2fa9f3340d6870468b94ac79bba => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:47.239438 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69636c-b8d7-41a5-8686-ff9f995a0549 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:47.240037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69636c-b8d7-41a5-8686-ff9f995a0549 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:47.240198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69636c-b8d7-41a5-8686-ff9f995a0549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:47.288673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-4c69636c-b8d7-41a5-8686-ff9f995a0549 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:47.295514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-4c69636c-b8d7-41a5-8686-ff9f995a0549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:47.436819 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1143/2282] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:47.450160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:47.452313 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:47.585916 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f669a6c-a4ab-4f2c-9bea-cd08ad185fef admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:47.598007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f57cb-e73f-47bd-9562-680bdd813e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:47.599621 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f57cb-e73f-47bd-9562-680bdd813e91 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:47.600056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f57cb-e73f-47bd-9562-680bdd813e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:47.600481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f57cb-e73f-47bd-9562-680bdd813e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:47.616021 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f57cb-e73f-47bd-9562-680bdd813e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:47.618050 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f57cb-e73f-47bd-9562-680bdd813e91 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:47.631201 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1140/2283] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:47.632344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e453942-acf0-4b6c-9560-c56b37ae8fda None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:47.632699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e453942-acf0-4b6c-9560-c56b37ae8fda None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:47.633191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e453942-acf0-4b6c-9560-c56b37ae8fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:47.681636 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-7e453942-acf0-4b6c-9560-c56b37ae8fda None None] MFA Rules not processed for user `0d6b8346f8144ec4bebdadd1e5572317`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:47.683224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7e453942-acf0-4b6c-9560-c56b37ae8fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:47.775939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1144/2284] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:47.780387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f57cb-e73f-47bd-9562-680bdd813e91 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:47.782137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-854f57cb-e73f-47bd-9562-680bdd813e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:47.804823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f57cb-e73f-47bd-9562-680bdd813e91 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:47.819594 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b1b36-0640-49a9-ad52-a2c2879ce3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:47.820873 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b1b36-0640-49a9-ad52-a2c2879ce3ba admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:47.821294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b1b36-0640-49a9-ad52-a2c2879ce3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:47.821736 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b1b36-0640-49a9-ad52-a2c2879ce3ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:47.822644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b1b36-0640-49a9-ad52-a2c2879ce3ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:47.824763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b1b36-0640-49a9-ad52-a2c2879ce3ba admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:47.863635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1141/2285] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:47 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:47.868589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e453942-acf0-4b6c-9560-c56b37ae8fda None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:47.885099 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e453942-acf0-4b6c-9560-c56b37ae8fda None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:47.964110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39659655-e226-415c-84ec-b86b88aefa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:47.964939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39659655-e226-415c-84ec-b86b88aefa80 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:47.965224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39659655-e226-415c-84ec-b86b88aefa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:47.965503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39659655-e226-415c-84ec-b86b88aefa80 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:47.966238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39659655-e226-415c-84ec-b86b88aefa80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:47.968398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39659655-e226-415c-84ec-b86b88aefa80 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:48.000945 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1145/2286] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:47 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:48.004871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b1b36-0640-49a9-ad52-a2c2879ce3ba admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:48.017863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b1b36-0640-49a9-ad52-a2c2879ce3ba admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:48.024846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd098b-bd7f-4e23-b982-752162a541a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:48.025823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd098b-bd7f-4e23-b982-752162a541a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:48.026108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd098b-bd7f-4e23-b982-752162a541a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:48.026591 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd098b-bd7f-4e23-b982-752162a541a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:48.027344 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd098b-bd7f-4e23-b982-752162a541a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:48.029051 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd098b-bd7f-4e23-b982-752162a541a3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:48.060678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1142/2287] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:48.065715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39659655-e226-415c-84ec-b86b88aefa80 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:48.090448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39659655-e226-415c-84ec-b86b88aefa80 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:48.103475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f160c2-a8f6-4829-a54e-71a5fe2fe43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:48.104393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f160c2-a8f6-4829-a54e-71a5fe2fe43c admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:48.104680 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f160c2-a8f6-4829-a54e-71a5fe2fe43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:48.104958 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f160c2-a8f6-4829-a54e-71a5fe2fe43c admin admin] PATH_INFO: `/v3/projects/acc95a1db9b04149bf00fa406decd5e0/users/b9ab6655901a4d499d66f4c69f5fe466/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:48.134672 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f160c2-a8f6-4829-a54e-71a5fe2fe43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc95a1db9b04149bf00fa406decd5e0, user_id=b9ab6655901a4d499d66f4c69f5fe466, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:48.145556 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f160c2-a8f6-4829-a54e-71a5fe2fe43c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:48.148150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd098b-bd7f-4e23-b982-752162a541a3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:48.152617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8abd098b-bd7f-4e23-b982-752162a541a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:48.171691 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1146/2288] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:48 2022] PUT /identity/v3/projects/acc95a1db9b04149bf00fa406decd5e0/users/b9ab6655901a4d499d66f4c69f5fe466/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:48.184349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd098b-bd7f-4e23-b982-752162a541a3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:48.187315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f160c2-a8f6-4829-a54e-71a5fe2fe43c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:48.305795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9af669-6ea5-4f61-ae66-bedf97f55423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:48.306853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af669-6ea5-4f61-ae66-bedf97f55423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:48.307215 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af669-6ea5-4f61-ae66-bedf97f55423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:48.307429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af669-6ea5-4f61-ae66-bedf97f55423 admin admin] PATH_INFO: `/v3/projects/2c6378a3978d441d8289a4ca48c3827e` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:48.308710 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9af669-6ea5-4f61-ae66-bedf97f55423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6378a3978d441d8289a4ca48c3827e)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:48.310711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9af669-6ea5-4f61-ae66-bedf97f55423 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:48.313964 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f160c2-a8f6-4829-a54e-71a5fe2fe43c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:48.324589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb2a40-e8da-413e-8afe-3bc54155efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:48.325682 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb2a40-e8da-413e-8afe-3bc54155efc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:48.326197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb2a40-e8da-413e-8afe-3bc54155efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:48.326871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb2a40-e8da-413e-8afe-3bc54155efc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:48.328203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb2a40-e8da-413e-8afe-3bc54155efc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:48.330292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb2a40-e8da-413e-8afe-3bc54155efc0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:48.352165 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1147/2289] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:48.353836 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb2a40-e8da-413e-8afe-3bc54155efc0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:48.369377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb2a40-e8da-413e-8afe-3bc54155efc0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:48.375518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd946e-41ea-449b-9707-eb6457b05e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:48.377061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd946e-41ea-449b-9707-eb6457b05e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:48.377628 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd946e-41ea-449b-9707-eb6457b05e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:48.378124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd946e-41ea-449b-9707-eb6457b05e88 admin admin] PATH_INFO: `/v3/projects/acc95a1db9b04149bf00fa406decd5e0/users/b9ab6655901a4d499d66f4c69f5fe466/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:48.381073 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd946e-41ea-449b-9707-eb6457b05e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc95a1db9b04149bf00fa406decd5e0, user_id=b9ab6655901a4d499d66f4c69f5fe466, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:48.411144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd946e-41ea-449b-9707-eb6457b05e88 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:48.440361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1148/2290] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:48 2022] PUT /identity/v3/projects/acc95a1db9b04149bf00fa406decd5e0/users/b9ab6655901a4d499d66f4c69f5fe466/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:48.446831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fe9af669-6ea5-4f61-ae66-bedf97f55423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6378a3978d441d8289a4ca48c3827e', 'request_id': 'req-fe9af669-6ea5-4f61-ae66-bedf97f55423'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:48.468077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fe9af669-6ea5-4f61-ae66-bedf97f55423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6378a3978d441d8289a4ca48c3827e', 'request_id': 'req-fe9af669-6ea5-4f61-ae66-bedf97f55423'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:48.479503 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fe9af669-6ea5-4f61-ae66-bedf97f55423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6378a3978d441d8289a4ca48c3827e', 'request_id': 'req-fe9af669-6ea5-4f61-ae66-bedf97f55423'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:48.495247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fe9af669-6ea5-4f61-ae66-bedf97f55423 admin admin] The token cache is being invalidate because project 2c6378a3978d441d8289a4ca48c3827e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:48.496131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fe9af669-6ea5-4f61-ae66-bedf97f55423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:48.498232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fe9af669-6ea5-4f61-ae66-bedf97f55423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:48.501044 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1143/2291] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:48 2022] DELETE /identity/v3/projects/2c6378a3978d441d8289a4ca48c3827e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:50.737713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd946e-41ea-449b-9707-eb6457b05e88 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:50.739472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a7dd946e-41ea-449b-9707-eb6457b05e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:50.905300 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd946e-41ea-449b-9707-eb6457b05e88 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:51.094522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:51.095865 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:51.096853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:51.097273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] PATH_INFO: `/v3/users/510b1c21176644c6b4ee2f30429eb2aa` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:51.098870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=510b1c21176644c6b4ee2f30429eb2aa)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:51.107456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:51.204105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510b1c21176644c6b4ee2f30429eb2aa'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:51.225694 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510b1c21176644c6b4ee2f30429eb2aa'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:51.245500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510b1c21176644c6b4ee2f30429eb2aa'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:51.246253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510b1c21176644c6b4ee2f30429eb2aa'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:51.254223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510b1c21176644c6b4ee2f30429eb2aa'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:51.267709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1149/2292] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:50 2022] DELETE /identity/v3/users/510b1c21176644c6b4ee2f30429eb2aa => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:51.272754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027509dd-ecc1-4309-86cc-97440e2c5b1e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:51.273295 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027509dd-ecc1-4309-86cc-97440e2c5b1e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:51.273772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027509dd-ecc1-4309-86cc-97440e2c5b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:51.340410 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-027509dd-ecc1-4309-86cc-97440e2c5b1e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:51.346778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-027509dd-ecc1-4309-86cc-97440e2c5b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:51.458325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1144/2293] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:51.479022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:51.480898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:51.591275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53200481-47d5-48f2-9055-4bf05f6f94d9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:51.595586 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7e75e-eeee-412f-82ac-da5c7fa1b616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:51.596384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7e75e-eeee-412f-82ac-da5c7fa1b616 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:51.596766 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7e75e-eeee-412f-82ac-da5c7fa1b616 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:51.597142 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7e75e-eeee-412f-82ac-da5c7fa1b616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:51.609334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7e75e-eeee-412f-82ac-da5c7fa1b616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:51.611087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7e75e-eeee-412f-82ac-da5c7fa1b616 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:51.625825 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1150/2294] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:52.398230 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027509dd-ecc1-4309-86cc-97440e2c5b1e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:52.403442 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-027509dd-ecc1-4309-86cc-97440e2c5b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:52.426489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027509dd-ecc1-4309-86cc-97440e2c5b1e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:52.435887 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:52.436846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:52.437222 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:52.437547 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc admin admin] PATH_INFO: `/v3/projects/d2b4c47b6b6044c582fed3a84357e02e` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:52.438808 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b4c47b6b6044c582fed3a84357e02e)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:52.440917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:52.549206 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b4c47b6b6044c582fed3a84357e02e', 'request_id': 'req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:52.566883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b4c47b6b6044c582fed3a84357e02e', 'request_id': 'req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:52.594381 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b4c47b6b6044c582fed3a84357e02e', 'request_id': 'req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:52.607945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc admin admin] The token cache is being invalidate because project d2b4c47b6b6044c582fed3a84357e02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:52.608499 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:52.609310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-134cb0e2-29a9-4fdd-ae2e-b054f0c988fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:52.611341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1145/2295] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:52 2022] DELETE /identity/v3/projects/d2b4c47b6b6044c582fed3a84357e02e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:52.616906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b59e0-1a1c-49dc-8bda-01007a1f3558 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:52.617430 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b59e0-1a1c-49dc-8bda-01007a1f3558 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:52.617779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b59e0-1a1c-49dc-8bda-01007a1f3558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:52.652729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-5c5b59e0-1a1c-49dc-8bda-01007a1f3558 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:52.654539 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5c5b59e0-1a1c-49dc-8bda-01007a1f3558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:52.812501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1151/2296] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:52.819891 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9048-e330-4893-81c6-e2fb2f102b30 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:52.820509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9048-e330-4893-81c6-e2fb2f102b30 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:52.821107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9048-e330-4893-81c6-e2fb2f102b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:52.844047 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-a6ca9048-e330-4893-81c6-e2fb2f102b30 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:52.845389 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a6ca9048-e330-4893-81c6-e2fb2f102b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:52.863577 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1146/2297] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:52.867955 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b59e0-1a1c-49dc-8bda-01007a1f3558 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:52.883360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b59e0-1a1c-49dc-8bda-01007a1f3558 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:52.888781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431b72d-fca8-4e7b-9682-492e01c59001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:52.889576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431b72d-fca8-4e7b-9682-492e01c59001 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:52.889967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431b72d-fca8-4e7b-9682-492e01c59001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:52.890481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431b72d-fca8-4e7b-9682-492e01c59001 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:52.891500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431b72d-fca8-4e7b-9682-492e01c59001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:39:52.891912 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431b72d-fca8-4e7b-9682-492e01c59001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:52.893849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431b72d-fca8-4e7b-9682-492e01c59001 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:52.913461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1152/2298] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:39:52.918241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca9048-e330-4893-81c6-e2fb2f102b30 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:52.929281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca9048-e330-4893-81c6-e2fb2f102b30 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:52.935519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b76231-8aff-4c65-960f-219a9f40ef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:52.936669 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b76231-8aff-4c65-960f-219a9f40ef9a admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:52.937693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b76231-8aff-4c65-960f-219a9f40ef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:52.938262 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b76231-8aff-4c65-960f-219a9f40ef9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:52.939200 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b76231-8aff-4c65-960f-219a9f40ef9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:52.941395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b76231-8aff-4c65-960f-219a9f40ef9a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:52.987055 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1147/2299] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:52 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:39:52.991446 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431b72d-fca8-4e7b-9682-492e01c59001 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:53.004237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431b72d-fca8-4e7b-9682-492e01c59001 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:53.109789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ecb71-4723-4c6e-a6cd-609249c57ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:53.110794 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ecb71-4723-4c6e-a6cd-609249c57ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:53.112049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ecb71-4723-4c6e-a6cd-609249c57ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:53.112458 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ecb71-4723-4c6e-a6cd-609249c57ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:53.113270 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ecb71-4723-4c6e-a6cd-609249c57ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:53.115666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ecb71-4723-4c6e-a6cd-609249c57ad9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:53.151451 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1153/2300] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:52 2022] POST /identity/v3/users => generated 282 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:53.156330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b76231-8aff-4c65-960f-219a9f40ef9a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:53.178705 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b76231-8aff-4c65-960f-219a9f40ef9a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:53.213817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bf5a2-6d6b-400c-bd66-270af25e0243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:53.214804 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bf5a2-6d6b-400c-bd66-270af25e0243 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:53.215241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bf5a2-6d6b-400c-bd66-270af25e0243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:53.215738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bf5a2-6d6b-400c-bd66-270af25e0243 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:53.216628 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bf5a2-6d6b-400c-bd66-270af25e0243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:53.218580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bf5a2-6d6b-400c-bd66-270af25e0243 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:53.242436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1148/2301] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:53.246893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ecb71-4723-4c6e-a6cd-609249c57ad9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:53.260396 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ecb71-4723-4c6e-a6cd-609249c57ad9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:53.270108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce89c0a-228a-43be-85e7-f2873272b65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:53.271398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce89c0a-228a-43be-85e7-f2873272b65b admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:53.271715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce89c0a-228a-43be-85e7-f2873272b65b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:53.271931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce89c0a-228a-43be-85e7-f2873272b65b admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:53.272662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce89c0a-228a-43be-85e7-f2873272b65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:53.274360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce89c0a-228a-43be-85e7-f2873272b65b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:53.318227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1154/2302] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:53.320863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bf5a2-6d6b-400c-bd66-270af25e0243 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:53.343084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bf5a2-6d6b-400c-bd66-270af25e0243 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:53.370842 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dee13-c56f-4457-825e-c018b4771794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:53.371756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dee13-c56f-4457-825e-c018b4771794 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:53.372034 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dee13-c56f-4457-825e-c018b4771794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:53.374991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dee13-c56f-4457-825e-c018b4771794 admin admin] PATH_INFO: `/v3/projects/aa0859255b604aac9df237c645c43447/users/91d04c50e9ef401d93978aae01e30ab2/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:53.424990 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dee13-c56f-4457-825e-c018b4771794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0859255b604aac9df237c645c43447, user_id=91d04c50e9ef401d93978aae01e30ab2, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:53.431899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dee13-c56f-4457-825e-c018b4771794 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:53.471419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1149/2303] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:53 2022] PUT /identity/v3/projects/aa0859255b604aac9df237c645c43447/users/91d04c50e9ef401d93978aae01e30ab2/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:53.483910 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da81ac-0f1e-40cd-8be2-534a1ce83b3d None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:53.484423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da81ac-0f1e-40cd-8be2-534a1ce83b3d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:53.484853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da81ac-0f1e-40cd-8be2-534a1ce83b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:53.544324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-47da81ac-0f1e-40cd-8be2-534a1ce83b3d None None] MFA Rules not processed for user `91d04c50e9ef401d93978aae01e30ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:53.545559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-47da81ac-0f1e-40cd-8be2-534a1ce83b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:53.661701 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1155/2304] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:53.675417 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dee13-c56f-4457-825e-c018b4771794 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:53.684279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a79dee13-c56f-4457-825e-c018b4771794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:53.758035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dee13-c56f-4457-825e-c018b4771794 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:53.763167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e6e60-46c2-45a1-b734-91180ee0c534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:53.763959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e6e60-46c2-45a1-b734-91180ee0c534 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:53.764523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e6e60-46c2-45a1-b734-91180ee0c534 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:53.765033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e6e60-46c2-45a1-b734-91180ee0c534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:53.776132 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e6e60-46c2-45a1-b734-91180ee0c534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:53.778526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e6e60-46c2-45a1-b734-91180ee0c534 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:53.800681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1150/2305] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:55.485667 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa50995-e9ba-4e5c-aa66-53131e03700d None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:55.486680 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa50995-e9ba-4e5c-aa66-53131e03700d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:55.487156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa50995-e9ba-4e5c-aa66-53131e03700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:55.522600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-2aa50995-e9ba-4e5c-aa66-53131e03700d None None] MFA Rules not processed for user `b9ab6655901a4d499d66f4c69f5fe466`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:55.523865 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-2aa50995-e9ba-4e5c-aa66-53131e03700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:55.631374 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1156/2306] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:39:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:55.646703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e6e60-46c2-45a1-b734-91180ee0c534 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:55.649850 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-457e6e60-46c2-45a1-b734-91180ee0c534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:55.721585 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e6e60-46c2-45a1-b734-91180ee0c534 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:55.726975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3d1cc-8a09-412b-a7c4-a5016edc4f13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68b3bc64dc94865a72cea0988fa9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:55.727909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d1cc-8a09-412b-a7c4-a5016edc4f13 service glance] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:55.728189 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d1cc-8a09-412b-a7c4-a5016edc4f13 service glance] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:55.728463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d1cc-8a09-412b-a7c4-a5016edc4f13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:55.730270 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d3c3d1cc-8a09-412b-a7c4-a5016edc4f13 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:55.797399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3d1cc-8a09-412b-a7c4-a5016edc4f13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:55.799368 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3d1cc-8a09-412b-a7c4-a5016edc4f13 service glance] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:55.812679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1151/2307] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:55.939468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf969-a2eb-4153-b755-6bcdbc4e5fba None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:55.939767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf969-a2eb-4153-b755-6bcdbc4e5fba None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:55.940051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf969-a2eb-4153-b755-6bcdbc4e5fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:55.959893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b58cf969-a2eb-4153-b755-6bcdbc4e5fba None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:55.961160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b58cf969-a2eb-4153-b755-6bcdbc4e5fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:56.017318 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1157/2308] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:39:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:56.056944 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3d1cc-8a09-412b-a7c4-a5016edc4f13 service glance] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:56.058345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d3c3d1cc-8a09-412b-a7c4-a5016edc4f13 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:56.130797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3d1cc-8a09-412b-a7c4-a5016edc4f13 service glance] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:56.135989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf765cc-a9dd-4aed-88ee-0d8d793c9575 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:56.136659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf765cc-a9dd-4aed-88ee-0d8d793c9575 service swift] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:56.136938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf765cc-a9dd-4aed-88ee-0d8d793c9575 service swift] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:56.137212 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf765cc-a9dd-4aed-88ee-0d8d793c9575 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:56.145109 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf765cc-a9dd-4aed-88ee-0d8d793c9575 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:56.147324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf765cc-a9dd-4aed-88ee-0d8d793c9575 service swift] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:56.155076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1152/2309] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:39:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:40:06.956435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b886c-9a2e-45a9-8785-8dae1af3dd78 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:06.957049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b886c-9a2e-45a9-8785-8dae1af3dd78 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:06.957049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b886c-9a2e-45a9-8785-8dae1af3dd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:06.982357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-740b886c-9a2e-45a9-8785-8dae1af3dd78 None None] MFA Rules not processed for user `0d6b8346f8144ec4bebdadd1e5572317`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:06.983828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-740b886c-9a2e-45a9-8785-8dae1af3dd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:07.001089 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1158/2310] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:11.677777 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bb9ba-2e4e-4d90-9723-191f7a3520fe None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:11.678455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bb9ba-2e4e-4d90-9723-191f7a3520fe None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:11.678552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bb9ba-2e4e-4d90-9723-191f7a3520fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:11.700010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-6c4bb9ba-2e4e-4d90-9723-191f7a3520fe None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:11.701314 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6c4bb9ba-2e4e-4d90-9723-191f7a3520fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:11.711659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1153/2311] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:40:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:11.725864 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b886c-9a2e-45a9-8785-8dae1af3dd78 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:11.738489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b886c-9a2e-45a9-8785-8dae1af3dd78 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:11.748150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1189e-36b9-4611-8146-771341045e4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:11.749130 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1189e-36b9-4611-8146-771341045e4c service swift] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:11.750372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1189e-36b9-4611-8146-771341045e4c service swift] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:11.750808 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1189e-36b9-4611-8146-771341045e4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:11.763619 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1189e-36b9-4611-8146-771341045e4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:11.766107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1189e-36b9-4611-8146-771341045e4c service swift] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:11.792869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1159/2312] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:40:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:40:20.399413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286902c0-4fd2-44ed-9358-8f15edf29c61 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:20.399951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286902c0-4fd2-44ed-9358-8f15edf29c61 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:20.400314 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286902c0-4fd2-44ed-9358-8f15edf29c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:20.420740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-286902c0-4fd2-44ed-9358-8f15edf29c61 None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:20.421902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-286902c0-4fd2-44ed-9358-8f15edf29c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:20.431711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1154/2313] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:40:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:20.444816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1189e-36b9-4611-8146-771341045e4c service swift] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:20.455333 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1189e-36b9-4611-8146-771341045e4c service swift] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:20.461167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4081357-603d-494b-9f74-91b36df4b6f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:20.461803 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081357-603d-494b-9f74-91b36df4b6f4 service swift] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:20.462088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081357-603d-494b-9f74-91b36df4b6f4 service swift] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:20.462400 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081357-603d-494b-9f74-91b36df4b6f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:20.470507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4081357-603d-494b-9f74-91b36df4b6f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:20.472072 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4081357-603d-494b-9f74-91b36df4b6f4 service swift] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:20.480484 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1160/2314] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:40:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:40:34.103141 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab06f27-da2b-4272-8322-52190b298aaa None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:34.104090 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab06f27-da2b-4272-8322-52190b298aaa None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:34.104440 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab06f27-da2b-4272-8322-52190b298aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:34.135496 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4ab06f27-da2b-4272-8322-52190b298aaa None None] MFA Rules not processed for user `2675a53d6286472895674a3be54131b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:34.136768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4ab06f27-da2b-4272-8322-52190b298aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:34.233122 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1155/2315] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:35.177898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e6e87-dc20-483e-bc8b-2d7e9de0ae7d None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:35.179805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e6e87-dc20-483e-bc8b-2d7e9de0ae7d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:35.180643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e6e87-dc20-483e-bc8b-2d7e9de0ae7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:35.205958 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-e59e6e87-dc20-483e-bc8b-2d7e9de0ae7d None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:35.208175 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e59e6e87-dc20-483e-bc8b-2d7e9de0ae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:35.269418 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1161/2316] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:40:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:35.334623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab06f27-da2b-4272-8322-52190b298aaa None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:35.356690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab06f27-da2b-4272-8322-52190b298aaa None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:35.363101 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee099641-7989-4ec5-902d-5fb9ed287586 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:35.364029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee099641-7989-4ec5-902d-5fb9ed287586 service swift] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:35.364505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee099641-7989-4ec5-902d-5fb9ed287586 service swift] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:35.365013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee099641-7989-4ec5-902d-5fb9ed287586 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:35.375643 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee099641-7989-4ec5-902d-5fb9ed287586 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:35.377718 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee099641-7989-4ec5-902d-5fb9ed287586 service swift] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:35.389287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1156/2317] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:40:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:40:44.789309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb24de-47d7-406c-b34c-506dcb75d1d9 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:44.789858 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb24de-47d7-406c-b34c-506dcb75d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:44.789858 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb24de-47d7-406c-b34c-506dcb75d1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:44.810314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-61eb24de-47d7-406c-b34c-506dcb75d1d9 None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:44.811521 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-61eb24de-47d7-406c-b34c-506dcb75d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:44.819614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1162/2318] 10.222.0.79 () {58 vars in 967 bytes} [Mon Feb 21 01:40:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:44.835049 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee099641-7989-4ec5-902d-5fb9ed287586 service swift] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:44.845933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee099641-7989-4ec5-902d-5fb9ed287586 service swift] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:44.851639 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c710a27-e7fe-4141-8792-2207d740d08d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:44.852586 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c710a27-e7fe-4141-8792-2207d740d08d service swift] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:44.853445 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c710a27-e7fe-4141-8792-2207d740d08d service swift] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:44.854189 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c710a27-e7fe-4141-8792-2207d740d08d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:44.868438 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c710a27-e7fe-4141-8792-2207d740d08d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:44.870038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c710a27-e7fe-4141-8792-2207d740d08d service swift] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:44.878661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1157/2319] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:40:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:40:46.819496 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb24de-47d7-406c-b34c-506dcb75d1d9 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:46.821103 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-61eb24de-47d7-406c-b34c-506dcb75d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:46.913415 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb24de-47d7-406c-b34c-506dcb75d1d9 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:46.917140 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5cda1-da03-4c74-a9fd-c01b508d6f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:46.917789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5cda1-da03-4c74-a9fd-c01b508d6f19 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:46.918068 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5cda1-da03-4c74-a9fd-c01b508d6f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:46.918449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5cda1-da03-4c74-a9fd-c01b508d6f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:46.928291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5cda1-da03-4c74-a9fd-c01b508d6f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:46.929757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5cda1-da03-4c74-a9fd-c01b508d6f19 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:46.940901 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1163/2320] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:40:47.343594 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c710a27-e7fe-4141-8792-2207d740d08d service swift] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:47.345098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8c710a27-e7fe-4141-8792-2207d740d08d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:47.489615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c710a27-e7fe-4141-8792-2207d740d08d service swift] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:47.496725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69de58e-8590-4672-b28b-bacccb6eb365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:47.497621 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69de58e-8590-4672-b28b-bacccb6eb365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:47.497908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69de58e-8590-4672-b28b-bacccb6eb365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:47.498187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69de58e-8590-4672-b28b-bacccb6eb365 admin admin] PATH_INFO: `/v3/users/c5792618a1d24270bce56d7b288b3896` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:47.499484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69de58e-8590-4672-b28b-bacccb6eb365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5792618a1d24270bce56d7b288b3896)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:47.503333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69de58e-8590-4672-b28b-bacccb6eb365 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:47.590349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d69de58e-8590-4672-b28b-bacccb6eb365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5792618a1d24270bce56d7b288b3896'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:47.598303 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d69de58e-8590-4672-b28b-bacccb6eb365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5792618a1d24270bce56d7b288b3896'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:47.609830 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d69de58e-8590-4672-b28b-bacccb6eb365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5792618a1d24270bce56d7b288b3896'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:47.610595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d69de58e-8590-4672-b28b-bacccb6eb365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5792618a1d24270bce56d7b288b3896'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:47.611210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d69de58e-8590-4672-b28b-bacccb6eb365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5792618a1d24270bce56d7b288b3896'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:47.625895 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1158/2321] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:40:47 2022] DELETE /identity/v3/users/c5792618a1d24270bce56d7b288b3896 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:40:47.840478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5cda1-da03-4c74-a9fd-c01b508d6f19 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:47.858173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5cda1-da03-4c74-a9fd-c01b508d6f19 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:47.990683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a1b6c-59eb-49cc-ac54-cf8863e083b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:47.992217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a1b6c-59eb-49cc-ac54-cf8863e083b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:47.992657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a1b6c-59eb-49cc-ac54-cf8863e083b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:47.993082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a1b6c-59eb-49cc-ac54-cf8863e083b2 admin admin] PATH_INFO: `/v3/projects/8d55ff8f89dd4efe91ad4e0f863808ee` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:47.995285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a1b6c-59eb-49cc-ac54-cf8863e083b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d55ff8f89dd4efe91ad4e0f863808ee)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:47.997862 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a1b6c-59eb-49cc-ac54-cf8863e083b2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:48.062909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-274a1b6c-59eb-49cc-ac54-cf8863e083b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d55ff8f89dd4efe91ad4e0f863808ee', 'request_id': 'req-274a1b6c-59eb-49cc-ac54-cf8863e083b2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:48.072905 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-274a1b6c-59eb-49cc-ac54-cf8863e083b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d55ff8f89dd4efe91ad4e0f863808ee', 'request_id': 'req-274a1b6c-59eb-49cc-ac54-cf8863e083b2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:48.085991 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-274a1b6c-59eb-49cc-ac54-cf8863e083b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d55ff8f89dd4efe91ad4e0f863808ee', 'request_id': 'req-274a1b6c-59eb-49cc-ac54-cf8863e083b2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:48.101151 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-274a1b6c-59eb-49cc-ac54-cf8863e083b2 admin admin] The token cache is being invalidate because project 8d55ff8f89dd4efe91ad4e0f863808ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:40:48.101449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-274a1b6c-59eb-49cc-ac54-cf8863e083b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:48.102101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-274a1b6c-59eb-49cc-ac54-cf8863e083b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:48.107216 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1164/2322] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:40:47 2022] DELETE /identity/v3/projects/8d55ff8f89dd4efe91ad4e0f863808ee => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:40:48.108950 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125c3b2-3626-4068-a6ab-25507bc4d1a5 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:48.109286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125c3b2-3626-4068-a6ab-25507bc4d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:48.110382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125c3b2-3626-4068-a6ab-25507bc4d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:48.180959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2125c3b2-3626-4068-a6ab-25507bc4d1a5 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:48.182185 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2125c3b2-3626-4068-a6ab-25507bc4d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:48.263768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1159/2323] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:48.265897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b2c2-4c9f-45e9-945a-9d0b703f50b1 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:48.266405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b2c2-4c9f-45e9-945a-9d0b703f50b1 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:48.266749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b2c2-4c9f-45e9-945a-9d0b703f50b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:48.306526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-e8b4b2c2-4c9f-45e9-945a-9d0b703f50b1 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:48.307886 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e8b4b2c2-4c9f-45e9-945a-9d0b703f50b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:48.318243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1165/2324] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:48.321595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125c3b2-3626-4068-a6ab-25507bc4d1a5 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:48.331306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125c3b2-3626-4068-a6ab-25507bc4d1a5 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:48.335844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461fb6d-8fe4-4195-afe2-e2799d5f9a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:48.336503 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461fb6d-8fe4-4195-afe2-e2799d5f9a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:48.337269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461fb6d-8fe4-4195-afe2-e2799d5f9a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:48.337548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461fb6d-8fe4-4195-afe2-e2799d5f9a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:48.338309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461fb6d-8fe4-4195-afe2-e2799d5f9a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:40:48.338614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461fb6d-8fe4-4195-afe2-e2799d5f9a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:48.340201 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461fb6d-8fe4-4195-afe2-e2799d5f9a55 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:48.353711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1160/2325] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:40:48.359272 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4b2c2-4c9f-45e9-945a-9d0b703f50b1 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:48.373300 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4b2c2-4c9f-45e9-945a-9d0b703f50b1 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:48.379454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6f9d6-566c-40ea-9f8a-be0926b46bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:48.381289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f9d6-566c-40ea-9f8a-be0926b46bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:48.381289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f9d6-566c-40ea-9f8a-be0926b46bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:48.381289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f9d6-566c-40ea-9f8a-be0926b46bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:48.381753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6f9d6-566c-40ea-9f8a-be0926b46bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:48.383933 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6f9d6-566c-40ea-9f8a-be0926b46bf7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:48.441018 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1166/2326] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:40:48 2022] POST /identity/v3/projects => generated 397 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:40:48.444868 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461fb6d-8fe4-4195-afe2-e2799d5f9a55 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:48.467748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461fb6d-8fe4-4195-afe2-e2799d5f9a55 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:48.551094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24960a6-d4c7-4e79-8db2-d363fb6cedca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:48.551583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24960a6-d4c7-4e79-8db2-d363fb6cedca admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:48.551864 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24960a6-d4c7-4e79-8db2-d363fb6cedca admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:48.552140 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24960a6-d4c7-4e79-8db2-d363fb6cedca admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:48.553012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24960a6-d4c7-4e79-8db2-d363fb6cedca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:48.555007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24960a6-d4c7-4e79-8db2-d363fb6cedca admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:48.611327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1161/2327] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:40:48 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:40:48.613304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6f9d6-566c-40ea-9f8a-be0926b46bf7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:48.627056 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6f9d6-566c-40ea-9f8a-be0926b46bf7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:48.632869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0251be5-bdf8-4cc8-b4bf-264194f2c3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:48.633629 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0251be5-bdf8-4cc8-b4bf-264194f2c3fa admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:48.633920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0251be5-bdf8-4cc8-b4bf-264194f2c3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:48.634268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0251be5-bdf8-4cc8-b4bf-264194f2c3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:48.634969 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0251be5-bdf8-4cc8-b4bf-264194f2c3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:48.636744 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0251be5-bdf8-4cc8-b4bf-264194f2c3fa admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:48.658402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1167/2328] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:40:48.662441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24960a6-d4c7-4e79-8db2-d363fb6cedca admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:48.681299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24960a6-d4c7-4e79-8db2-d363fb6cedca admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:48.692604 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35aee1-fafc-4fd1-a5e9-e32b258af1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:48.694172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35aee1-fafc-4fd1-a5e9-e32b258af1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:48.694674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35aee1-fafc-4fd1-a5e9-e32b258af1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:48.695227 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35aee1-fafc-4fd1-a5e9-e32b258af1fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:48.696426 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35aee1-fafc-4fd1-a5e9-e32b258af1fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:48.698475 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35aee1-fafc-4fd1-a5e9-e32b258af1fa admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:48.716508 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1162/2329] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:40:48.717074 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0251be5-bdf8-4cc8-b4bf-264194f2c3fa admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:48.730242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0251be5-bdf8-4cc8-b4bf-264194f2c3fa admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:48.736186 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c59f3-356d-4ef8-831f-e4263cae81b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:48.738806 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c59f3-356d-4ef8-831f-e4263cae81b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:48.739308 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c59f3-356d-4ef8-831f-e4263cae81b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:48.739781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c59f3-356d-4ef8-831f-e4263cae81b1 admin admin] PATH_INFO: `/v3/projects/c2e9a57423b748e39666ec4662ac8bd6/users/4347325ee9004ce08b5335d005cf28ac/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:48.758868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c59f3-356d-4ef8-831f-e4263cae81b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e9a57423b748e39666ec4662ac8bd6, user_id=4347325ee9004ce08b5335d005cf28ac, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:48.763304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c59f3-356d-4ef8-831f-e4263cae81b1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:48.799411 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1168/2330] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:40:48 2022] PUT /identity/v3/projects/c2e9a57423b748e39666ec4662ac8bd6/users/4347325ee9004ce08b5335d005cf28ac/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:40:48.801950 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac54dba-f304-4209-a0a4-e4588b76219d None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:48.802191 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac54dba-f304-4209-a0a4-e4588b76219d None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:48.802569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac54dba-f304-4209-a0a4-e4588b76219d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:48.833789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0ac54dba-f304-4209-a0a4-e4588b76219d None None] MFA Rules not processed for user `4347325ee9004ce08b5335d005cf28ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:48.835123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0ac54dba-f304-4209-a0a4-e4588b76219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:48.918351 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1163/2331] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:48.925624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c59f3-356d-4ef8-831f-e4263cae81b1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:48.928909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a93c59f3-356d-4ef8-831f-e4263cae81b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:49.005821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c59f3-356d-4ef8-831f-e4263cae81b1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:49.009881 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc0432-4fb1-416f-8ba1-b4689664e12f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:49.010662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc0432-4fb1-416f-8ba1-b4689664e12f service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:49.010938 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc0432-4fb1-416f-8ba1-b4689664e12f service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:49.011197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc0432-4fb1-416f-8ba1-b4689664e12f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:49.022325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc0432-4fb1-416f-8ba1-b4689664e12f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:49.024145 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc0432-4fb1-416f-8ba1-b4689664e12f service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:49.035839 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1169/2332] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:40:57.206552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac54dba-f304-4209-a0a4-e4588b76219d None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:57.208032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0ac54dba-f304-4209-a0a4-e4588b76219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:57.257027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc0432-4fb1-416f-8ba1-b4689664e12f service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:57.274025 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac54dba-f304-4209-a0a4-e4588b76219d None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:57.278665 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b7ea3-23ea-42a9-9558-c507f0bec08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:57.279663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b7ea3-23ea-42a9-9558-c507f0bec08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.279950 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b7ea3-23ea-42a9-9558-c507f0bec08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.280226 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b7ea3-23ea-42a9-9558-c507f0bec08e admin admin] PATH_INFO: `/v3/users/91d04c50e9ef401d93978aae01e30ab2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.281551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b7ea3-23ea-42a9-9558-c507f0bec08e admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d04c50e9ef401d93978aae01e30ab2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:57.283812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b7ea3-23ea-42a9-9558-c507f0bec08e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:57.325849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc0432-4fb1-416f-8ba1-b4689664e12f service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:57.331604 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d9723-e591-45d3-b163-1ad09b778dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:57.332576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d9723-e591-45d3-b163-1ad09b778dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.332752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d9723-e591-45d3-b163-1ad09b778dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.333233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d9723-e591-45d3-b163-1ad09b778dfd admin admin] PATH_INFO: `/v3/users/4347325ee9004ce08b5335d005cf28ac` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.334966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d9723-e591-45d3-b163-1ad09b778dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4347325ee9004ce08b5335d005cf28ac)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:57.336582 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d9723-e591-45d3-b163-1ad09b778dfd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:57.345124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-136b7ea3-23ea-42a9-9558-c507f0bec08e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d04c50e9ef401d93978aae01e30ab2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:57.353346 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-136b7ea3-23ea-42a9-9558-c507f0bec08e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d04c50e9ef401d93978aae01e30ab2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:57.367856 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-136b7ea3-23ea-42a9-9558-c507f0bec08e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d04c50e9ef401d93978aae01e30ab2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:57.368775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-136b7ea3-23ea-42a9-9558-c507f0bec08e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d04c50e9ef401d93978aae01e30ab2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:57.369521 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-136b7ea3-23ea-42a9-9558-c507f0bec08e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d04c50e9ef401d93978aae01e30ab2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:57.383540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1164/2333] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:40:57 2022] DELETE /identity/v3/users/91d04c50e9ef401d93978aae01e30ab2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:40:57.384860 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb220e87-49bb-441d-85a5-9f0e1d05ce24 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.385155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb220e87-49bb-441d-85a5-9f0e1d05ce24 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.385441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb220e87-49bb-441d-85a5-9f0e1d05ce24 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.387421 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1165/2334] 10.222.0.79 () {54 vars in 921 bytes} [Mon Feb 21 01:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:40:57.388489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9442-b09c-49e7-be1d-ce7e9bd3bf0c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.388879 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9442-b09c-49e7-be1d-ce7e9bd3bf0c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.389161 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9442-b09c-49e7-be1d-ce7e9bd3bf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.400337 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8d6d9723-e591-45d3-b163-1ad09b778dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4347325ee9004ce08b5335d005cf28ac'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:57.405785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8d6d9723-e591-45d3-b163-1ad09b778dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4347325ee9004ce08b5335d005cf28ac'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:57.413220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-6a2e9442-b09c-49e7-be1d-ce7e9bd3bf0c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:57.415195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6a2e9442-b09c-49e7-be1d-ce7e9bd3bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:57.418967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8d6d9723-e591-45d3-b163-1ad09b778dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4347325ee9004ce08b5335d005cf28ac'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:57.419666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8d6d9723-e591-45d3-b163-1ad09b778dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4347325ee9004ce08b5335d005cf28ac'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:57.428460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8d6d9723-e591-45d3-b163-1ad09b778dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4347325ee9004ce08b5335d005cf28ac'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:57.437023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1170/2335] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:40:57 2022] DELETE /identity/v3/users/4347325ee9004ce08b5335d005cf28ac => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:40:57.438814 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5554fe4-0fea-4ab8-a024-e7ecfe48b213 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.439339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5554fe4-0fea-4ab8-a024-e7ecfe48b213 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.440005 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5554fe4-0fea-4ab8-a024-e7ecfe48b213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.478401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-f5554fe4-0fea-4ab8-a024-e7ecfe48b213 None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:57.479600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f5554fe4-0fea-4ab8-a024-e7ecfe48b213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:57.483266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1166/2336] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:57.484929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f294-886f-4f8a-b6ea-ff125b7a3fdc None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.484929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f294-886f-4f8a-b6ea-ff125b7a3fdc None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.485479 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f294-886f-4f8a-b6ea-ff125b7a3fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.504991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-af35f294-886f-4f8a-b6ea-ff125b7a3fdc None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:57.506414 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-af35f294-886f-4f8a-b6ea-ff125b7a3fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:57.553275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1171/2337] 10.222.0.79 () {58 vars in 1018 bytes} [Mon Feb 21 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:57.554124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5554fe4-0fea-4ab8-a024-e7ecfe48b213 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:57.555444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f5554fe4-0fea-4ab8-a024-e7ecfe48b213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:57.565757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1167/2338] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:57.566614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35f294-886f-4f8a-b6ea-ff125b7a3fdc None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:57.567864 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-af35f294-886f-4f8a-b6ea-ff125b7a3fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:57.609433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5554fe4-0fea-4ab8-a024-e7ecfe48b213 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:57.613200 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a13ce6-bb41-416b-9166-c9735077c82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:57.613967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a13ce6-bb41-416b-9166-c9735077c82f service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.615502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a13ce6-bb41-416b-9166-c9735077c82f service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.615782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a13ce6-bb41-416b-9166-c9735077c82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.622792 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35f294-886f-4f8a-b6ea-ff125b7a3fdc None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:57.625306 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a13ce6-bb41-416b-9166-c9735077c82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:57.626725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8709c-d60c-4d2d-8862-f21f46e1783e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68b3bc64dc94865a72cea0988fa9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:57.626891 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a13ce6-bb41-416b-9166-c9735077c82f service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:57.627675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8709c-d60c-4d2d-8862-f21f46e1783e service glance] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.628115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8709c-d60c-4d2d-8862-f21f46e1783e service glance] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.628565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8709c-d60c-4d2d-8862-f21f46e1783e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.636572 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1172/2339] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:40:57.637332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a13ce6-bb41-416b-9166-c9735077c82f service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:57.641278 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8709c-d60c-4d2d-8862-f21f46e1783e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:57.645221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8709c-d60c-4d2d-8862-f21f46e1783e service glance] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:57.646303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a13ce6-bb41-416b-9166-c9735077c82f service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:57.650740 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae85767-1c9c-455d-94c8-7eb946c2fceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:57.651592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae85767-1c9c-455d-94c8-7eb946c2fceb service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.651879 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae85767-1c9c-455d-94c8-7eb946c2fceb service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.652154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae85767-1c9c-455d-94c8-7eb946c2fceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.657003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1168/2340] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:40:57.665334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae85767-1c9c-455d-94c8-7eb946c2fceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:57.667287 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae85767-1c9c-455d-94c8-7eb946c2fceb service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:57.679167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1173/2341] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:40:57.727195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea109f-65bb-425d-a0f2-b6b31acfc751 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.727604 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea109f-65bb-425d-a0f2-b6b31acfc751 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.728262 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea109f-65bb-425d-a0f2-b6b31acfc751 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.730170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1169/2342] 10.222.0.79 () {54 vars in 921 bytes} [Mon Feb 21 01:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:40:57.735331 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b499e9-b566-434c-aa3e-6152654432d1 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.735811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b499e9-b566-434c-aa3e-6152654432d1 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.736160 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b499e9-b566-434c-aa3e-6152654432d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.757063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-06b499e9-b566-434c-aa3e-6152654432d1 None None] MFA Rules not processed for user `3f00b174c88547e2ab799d89a50d5b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:57.758411 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-06b499e9-b566-434c-aa3e-6152654432d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:57.765489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1174/2343] 10.222.0.79 () {58 vars in 1018 bytes} [Mon Feb 21 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:57.777508 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea109f-65bb-425d-a0f2-b6b31acfc751 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:57.780192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b8ea109f-65bb-425d-a0f2-b6b31acfc751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:57.794065 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea109f-65bb-425d-a0f2-b6b31acfc751 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:57.797689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a70b0f-91a7-4294-a37f-2cc87bc09b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:57.798362 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a70b0f-91a7-4294-a37f-2cc87bc09b8d service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.798640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a70b0f-91a7-4294-a37f-2cc87bc09b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.798911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a70b0f-91a7-4294-a37f-2cc87bc09b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.806773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a70b0f-91a7-4294-a37f-2cc87bc09b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:57.808192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a70b0f-91a7-4294-a37f-2cc87bc09b8d service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:57.815881 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1170/2344] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:40:57.933577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b89d5-1751-4c21-ab81-1baa6f763523 None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.933884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b89d5-1751-4c21-ab81-1baa6f763523 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.934164 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b89d5-1751-4c21-ab81-1baa6f763523 None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.936913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1175/2345] 10.222.0.79 () {54 vars in 921 bytes} [Mon Feb 21 01:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:40:57.944783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aeb65-70d5-453e-bbc6-27c9c69564d8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:57.945419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aeb65-70d5-453e-bbc6-27c9c69564d8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:57.945742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aeb65-70d5-453e-bbc6-27c9c69564d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:57.965446 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-525aeb65-70d5-453e-bbc6-27c9c69564d8 None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:57.966727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-525aeb65-70d5-453e-bbc6-27c9c69564d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:57.977308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1171/2346] 10.222.0.79 () {58 vars in 1018 bytes} [Mon Feb 21 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:40:57.993029 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b89d5-1751-4c21-ab81-1baa6f763523 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.007072 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aeb65-70d5-453e-bbc6-27c9c69564d8 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.009776 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-525aeb65-70d5-453e-bbc6-27c9c69564d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:58.015187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b89d5-1751-4c21-ab81-1baa6f763523 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.021271 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eec405-21b8-4b14-b8c7-ea9af8f9ab82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.022495 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eec405-21b8-4b14-b8c7-ea9af8f9ab82 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.022872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eec405-21b8-4b14-b8c7-ea9af8f9ab82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.023224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eec405-21b8-4b14-b8c7-ea9af8f9ab82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.030150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aeb65-70d5-453e-bbc6-27c9c69564d8 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.037199 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.038272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.038613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.038891 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6 admin admin] PATH_INFO: `/v3/projects/aa0859255b604aac9df237c645c43447` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.040615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0859255b604aac9df237c645c43447)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.042618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.047828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eec405-21b8-4b14-b8c7-ea9af8f9ab82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.049748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eec405-21b8-4b14-b8c7-ea9af8f9ab82 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.071906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1176/2347] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:40:58.072758 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eec405-21b8-4b14-b8c7-ea9af8f9ab82 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.075602 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-73eec405-21b8-4b14-b8c7-ea9af8f9ab82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:58.103124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eec405-21b8-4b14-b8c7-ea9af8f9ab82 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.108258 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86c525-864e-4e44-a55f-7dfa4570fdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.109202 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86c525-864e-4e44-a55f-7dfa4570fdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.109665 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86c525-864e-4e44-a55f-7dfa4570fdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.109844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86c525-864e-4e44-a55f-7dfa4570fdc4 admin admin] PATH_INFO: `/v3/projects/c2e9a57423b748e39666ec4662ac8bd6` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.111237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86c525-864e-4e44-a55f-7dfa4570fdc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2e9a57423b748e39666ec4662ac8bd6)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.113232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86c525-864e-4e44-a55f-7dfa4570fdc4 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.121934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0859255b604aac9df237c645c43447', 'request_id': 'req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:58.128418 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0859255b604aac9df237c645c43447', 'request_id': 'req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:58.138738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0859255b604aac9df237c645c43447', 'request_id': 'req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:58.164032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6 admin admin] The token cache is being invalidate because project aa0859255b604aac9df237c645c43447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:40:58.164332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:58.165561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8bfdf844-cd56-4ca6-88fa-5cd9aa1520a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:58.171457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1172/2348] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:40:58 2022] DELETE /identity/v3/projects/aa0859255b604aac9df237c645c43447 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:40:58.174422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62b887-9483-4cef-af84-7f3657aa1455 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.176042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62b887-9483-4cef-af84-7f3657aa1455 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.176359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62b887-9483-4cef-af84-7f3657aa1455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.202119 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8b86c525-864e-4e44-a55f-7dfa4570fdc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e9a57423b748e39666ec4662ac8bd6', 'request_id': 'req-8b86c525-864e-4e44-a55f-7dfa4570fdc4'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:58.207745 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8b86c525-864e-4e44-a55f-7dfa4570fdc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e9a57423b748e39666ec4662ac8bd6', 'request_id': 'req-8b86c525-864e-4e44-a55f-7dfa4570fdc4'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:58.210935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-ae62b887-9483-4cef-af84-7f3657aa1455 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:58.212286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ae62b887-9483-4cef-af84-7f3657aa1455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:58.220027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8b86c525-864e-4e44-a55f-7dfa4570fdc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e9a57423b748e39666ec4662ac8bd6', 'request_id': 'req-8b86c525-864e-4e44-a55f-7dfa4570fdc4'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:58.236139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8b86c525-864e-4e44-a55f-7dfa4570fdc4 admin admin] The token cache is being invalidate because project c2e9a57423b748e39666ec4662ac8bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:40:58.236545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8b86c525-864e-4e44-a55f-7dfa4570fdc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:58.237663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8b86c525-864e-4e44-a55f-7dfa4570fdc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:40:58.243386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1177/2349] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:40:58 2022] DELETE /identity/v3/projects/c2e9a57423b748e39666ec4662ac8bd6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:40:58.245243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1bff3-69a3-48fb-ba09-3c221daa5f95 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.245626 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1bff3-69a3-48fb-ba09-3c221daa5f95 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.245970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1bff3-69a3-48fb-ba09-3c221daa5f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.265756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-89f1bff3-69a3-48fb-ba09-3c221daa5f95 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:58.267061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-89f1bff3-69a3-48fb-ba09-3c221daa5f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:58.300470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1173/2350] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:58.308587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a461-5f50-4b11-8c14-8c4f86077516 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.308877 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a461-5f50-4b11-8c14-8c4f86077516 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.309825 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a461-5f50-4b11-8c14-8c4f86077516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.327718 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-adc8a461-5f50-4b11-8c14-8c4f86077516 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:58.328906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-adc8a461-5f50-4b11-8c14-8c4f86077516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:58.339630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1174/2351] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:40:58.344027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a461-5f50-4b11-8c14-8c4f86077516 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.348260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1178/2352] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:58.356572 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a461-5f50-4b11-8c14-8c4f86077516 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.356919 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cd00-8c69-4a3b-9f53-16151615c8e8 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.357216 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cd00-8c69-4a3b-9f53-16151615c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.357497 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cd00-8c69-4a3b-9f53-16151615c8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.361326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5236e7-029c-46c0-bec9-2884a9bbd367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.361978 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5236e7-029c-46c0-bec9-2884a9bbd367 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.362295 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5236e7-029c-46c0-bec9-2884a9bbd367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.362573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5236e7-029c-46c0-bec9-2884a9bbd367 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.363306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5236e7-029c-46c0-bec9-2884a9bbd367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:40:58.363739 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5236e7-029c-46c0-bec9-2884a9bbd367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.365769 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5236e7-029c-46c0-bec9-2884a9bbd367 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.376824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c648cd00-8c69-4a3b-9f53-16151615c8e8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:58.377962 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1175/2353] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:40:58.378681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c648cd00-8c69-4a3b-9f53-16151615c8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:58.382298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5236e7-029c-46c0-bec9-2884a9bbd367 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.390531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1179/2354] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:40:58.391721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648cd00-8c69-4a3b-9f53-16151615c8e8 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.392470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5236e7-029c-46c0-bec9-2884a9bbd367 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.399057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77894c-ce2b-4f38-9908-4d1fb6818372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.400342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77894c-ce2b-4f38-9908-4d1fb6818372 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.400630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77894c-ce2b-4f38-9908-4d1fb6818372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.400906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77894c-ce2b-4f38-9908-4d1fb6818372 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.401124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648cd00-8c69-4a3b-9f53-16151615c8e8 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.402157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77894c-ce2b-4f38-9908-4d1fb6818372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.405069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77894c-ce2b-4f38-9908-4d1fb6818372 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.407625 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992eca7-65db-4465-8ee8-95314bc8964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.408179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992eca7-65db-4465-8ee8-95314bc8964c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.408463 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992eca7-65db-4465-8ee8-95314bc8964c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.408744 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992eca7-65db-4465-8ee8-95314bc8964c admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.409471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992eca7-65db-4465-8ee8-95314bc8964c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:40:58.409921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992eca7-65db-4465-8ee8-95314bc8964c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.412146 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992eca7-65db-4465-8ee8-95314bc8964c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.424196 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1180/2355] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:40:58.428954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992eca7-65db-4465-8ee8-95314bc8964c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.438977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992eca7-65db-4465-8ee8-95314bc8964c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.445753 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1176/2356] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:40:58 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:40:58.445914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfe872-0785-4288-9e2e-f26eb6d2e63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.445914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfe872-0785-4288-9e2e-f26eb6d2e63e admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.445914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfe872-0785-4288-9e2e-f26eb6d2e63e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.445914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfe872-0785-4288-9e2e-f26eb6d2e63e admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.446316 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfe872-0785-4288-9e2e-f26eb6d2e63e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.447628 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfe872-0785-4288-9e2e-f26eb6d2e63e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.455058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77894c-ce2b-4f38-9908-4d1fb6818372 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.484344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1181/2357] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:40:58 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:40:58.488316 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfe872-0785-4288-9e2e-f26eb6d2e63e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.541578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77894c-ce2b-4f38-9908-4d1fb6818372 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.571110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfe872-0785-4288-9e2e-f26eb6d2e63e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.580748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29630a-6ff8-4bed-84e3-08b3a708ac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.581658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29630a-6ff8-4bed-84e3-08b3a708ac5b admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.582012 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29630a-6ff8-4bed-84e3-08b3a708ac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.582384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29630a-6ff8-4bed-84e3-08b3a708ac5b admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.583813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29630a-6ff8-4bed-84e3-08b3a708ac5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.585931 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29630a-6ff8-4bed-84e3-08b3a708ac5b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.608008 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a8d2-fdcd-4255-8590-0faa330aa283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.608675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a8d2-fdcd-4255-8590-0faa330aa283 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.608960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a8d2-fdcd-4255-8590-0faa330aa283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.609237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a8d2-fdcd-4255-8590-0faa330aa283 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.609930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a8d2-fdcd-4255-8590-0faa330aa283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.613771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1182/2358] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:40:58 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:40:58.613921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a8d2-fdcd-4255-8590-0faa330aa283 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.615217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29630a-6ff8-4bed-84e3-08b3a708ac5b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.626941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29630a-6ff8-4bed-84e3-08b3a708ac5b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.632503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f1f7f-5e73-4b58-9954-0a720f051bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.633061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f1f7f-5e73-4b58-9954-0a720f051bfb admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.633332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f1f7f-5e73-4b58-9954-0a720f051bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.633449 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1177/2359] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:40:58 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:40:58.633896 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f1f7f-5e73-4b58-9954-0a720f051bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.635077 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f1f7f-5e73-4b58-9954-0a720f051bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.637730 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a8d2-fdcd-4255-8590-0faa330aa283 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.638248 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f1f7f-5e73-4b58-9954-0a720f051bfb admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.651967 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a8d2-fdcd-4255-8590-0faa330aa283 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.654677 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1183/2360] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:40:58.655675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f1f7f-5e73-4b58-9954-0a720f051bfb admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.658671 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ab5aa-2490-4879-8763-844ea8fd1f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.659393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ab5aa-2490-4879-8763-844ea8fd1f96 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.659668 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ab5aa-2490-4879-8763-844ea8fd1f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.666144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ab5aa-2490-4879-8763-844ea8fd1f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.666652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f1f7f-5e73-4b58-9954-0a720f051bfb admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.667170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ab5aa-2490-4879-8763-844ea8fd1f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.669759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ab5aa-2490-4879-8763-844ea8fd1f96 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.672100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589ac58-5b8d-49a8-8645-70eb723fbdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.673117 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589ac58-5b8d-49a8-8645-70eb723fbdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.673409 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589ac58-5b8d-49a8-8645-70eb723fbdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.673689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589ac58-5b8d-49a8-8645-70eb723fbdc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.674863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589ac58-5b8d-49a8-8645-70eb723fbdc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.676846 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589ac58-5b8d-49a8-8645-70eb723fbdc4 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.686250 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1178/2361] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:40:58.689277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ab5aa-2490-4879-8763-844ea8fd1f96 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.691048 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1184/2362] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:40:58.697000 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589ac58-5b8d-49a8-8645-70eb723fbdc4 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.700517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ab5aa-2490-4879-8763-844ea8fd1f96 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.706010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c8547-7e47-499f-be05-7d5488591e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.706721 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c8547-7e47-499f-be05-7d5488591e46 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.707009 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c8547-7e47-499f-be05-7d5488591e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.707292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c8547-7e47-499f-be05-7d5488591e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.708677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c8547-7e47-499f-be05-7d5488591e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.708890 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589ac58-5b8d-49a8-8645-70eb723fbdc4 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.710420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c8547-7e47-499f-be05-7d5488591e46 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.713455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c961ba2-9699-4481-a5c8-ad171443c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.714368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c961ba2-9699-4481-a5c8-ad171443c30d admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.714652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c961ba2-9699-4481-a5c8-ad171443c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.714928 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c961ba2-9699-4481-a5c8-ad171443c30d admin admin] PATH_INFO: `/v3/projects/a516f78770624beba1baee79a4694c7a/users/d40b20a8c16d4771b4410f975e9f2a9d/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.720833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1179/2363] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:40:58.726584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c8547-7e47-499f-be05-7d5488591e46 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.732408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c961ba2-9699-4481-a5c8-ad171443c30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a516f78770624beba1baee79a4694c7a, user_id=d40b20a8c16d4771b4410f975e9f2a9d, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.735108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c961ba2-9699-4481-a5c8-ad171443c30d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.736880 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c8547-7e47-499f-be05-7d5488591e46 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.742180 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b3c39-f901-4659-9a4c-4bf1eace8e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.743005 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b3c39-f901-4659-9a4c-4bf1eace8e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.743286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b3c39-f901-4659-9a4c-4bf1eace8e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.743674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b3c39-f901-4659-9a4c-4bf1eace8e86 admin admin] PATH_INFO: `/v3/projects/4f7dbed5840d4227ab62e42f9a49fbce/users/a01201ddd64c4731992569cc38ca2276/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.753513 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1185/2364] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:40:58 2022] PUT /identity/v3/projects/a516f78770624beba1baee79a4694c7a/users/d40b20a8c16d4771b4410f975e9f2a9d/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:40:58.758627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cd483-397e-4f7e-a368-6f4c37a6d056 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.758916 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cd483-397e-4f7e-a368-6f4c37a6d056 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.759197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cd483-397e-4f7e-a368-6f4c37a6d056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.760745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b3c39-f901-4659-9a4c-4bf1eace8e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7dbed5840d4227ab62e42f9a49fbce, user_id=a01201ddd64c4731992569cc38ca2276, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.763451 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b3c39-f901-4659-9a4c-4bf1eace8e86 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.777416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-049cd483-397e-4f7e-a368-6f4c37a6d056 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:58.777670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1180/2365] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:40:58 2022] PUT /identity/v3/projects/4f7dbed5840d4227ab62e42f9a49fbce/users/a01201ddd64c4731992569cc38ca2276/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:40:58.778796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-049cd483-397e-4f7e-a368-6f4c37a6d056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:58.782554 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5b3ff-3d91-465c-a66f-88317bbba429 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.783471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5b3ff-3d91-465c-a66f-88317bbba429 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.783754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5b3ff-3d91-465c-a66f-88317bbba429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.802042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-65e5b3ff-3d91-465c-a66f-88317bbba429 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:40:58.803251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-65e5b3ff-3d91-465c-a66f-88317bbba429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:58.838157 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1186/2366] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:40:58.847810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cd483-397e-4f7e-a368-6f4c37a6d056 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.849191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-049cd483-397e-4f7e-a368-6f4c37a6d056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:58.861675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1181/2367] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:40:58.871290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5b3ff-3d91-465c-a66f-88317bbba429 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:58.872660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-65e5b3ff-3d91-465c-a66f-88317bbba429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:58.905974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cd483-397e-4f7e-a368-6f4c37a6d056 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.909821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b8a1c-84a5-4243-a04f-87881ddcdd5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.910492 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b8a1c-84a5-4243-a04f-87881ddcdd5b service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.910779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b8a1c-84a5-4243-a04f-87881ddcdd5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.911077 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b8a1c-84a5-4243-a04f-87881ddcdd5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.920114 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b8a1c-84a5-4243-a04f-87881ddcdd5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.921545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b8a1c-84a5-4243-a04f-87881ddcdd5b service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.926511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5b3ff-3d91-465c-a66f-88317bbba429 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:58.930119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac878a99-6269-4ae6-82d8-0472f198bb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:58.930783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac878a99-6269-4ae6-82d8-0472f198bb9a service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:58.931371 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac878a99-6269-4ae6-82d8-0472f198bb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:58.931582 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1187/2368] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:40:58.931675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac878a99-6269-4ae6-82d8-0472f198bb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:58.940327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac878a99-6269-4ae6-82d8-0472f198bb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:58.941759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac878a99-6269-4ae6-82d8-0472f198bb9a service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:58.952142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1182/2369] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:41:06.893901 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a98f1-3d37-40fc-b6e1-810abdb4a576 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:06.894945 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a98f1-3d37-40fc-b6e1-810abdb4a576 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:06.895987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a98f1-3d37-40fc-b6e1-810abdb4a576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:06.946595 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-102a98f1-3d37-40fc-b6e1-810abdb4a576 None None] MFA Rules not processed for user `d40b20a8c16d4771b4410f975e9f2a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:06.948596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-102a98f1-3d37-40fc-b6e1-810abdb4a576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:07.100749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1188/2370] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:41:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:07.105294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac878a99-6269-4ae6-82d8-0472f198bb9a service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:07.116097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac878a99-6269-4ae6-82d8-0472f198bb9a service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:07.121834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ab445-5b0e-457b-bf9b-2195bdf6f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:07.122547 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ab445-5b0e-457b-bf9b-2195bdf6f24d admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:07.122832 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ab445-5b0e-457b-bf9b-2195bdf6f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:07.123103 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ab445-5b0e-457b-bf9b-2195bdf6f24d admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:07.123800 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ab445-5b0e-457b-bf9b-2195bdf6f24d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:07.125904 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ab445-5b0e-457b-bf9b-2195bdf6f24d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:07.157797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1183/2371] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:41:07 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:41:07.161735 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a98f1-3d37-40fc-b6e1-810abdb4a576 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:07.179840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a98f1-3d37-40fc-b6e1-810abdb4a576 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:07.271945 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41c3c2-7d1f-4353-bc31-3da4c0b51fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:07.272637 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41c3c2-7d1f-4353-bc31-3da4c0b51fcd admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:07.273063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41c3c2-7d1f-4353-bc31-3da4c0b51fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:07.273351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41c3c2-7d1f-4353-bc31-3da4c0b51fcd admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:07.274098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41c3c2-7d1f-4353-bc31-3da4c0b51fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:07.276399 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41c3c2-7d1f-4353-bc31-3da4c0b51fcd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:07.308023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1189/2372] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:41:07 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:41:07.311654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ab445-5b0e-457b-bf9b-2195bdf6f24d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:07.327202 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ab445-5b0e-457b-bf9b-2195bdf6f24d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:07.336283 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599602d-7954-445f-a429-60a25caddf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:07.336806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599602d-7954-445f-a429-60a25caddf82 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:07.337553 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599602d-7954-445f-a429-60a25caddf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:07.337553 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599602d-7954-445f-a429-60a25caddf82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:07.338235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599602d-7954-445f-a429-60a25caddf82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:07.339876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599602d-7954-445f-a429-60a25caddf82 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:07.352209 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1184/2373] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:41:07.356727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41c3c2-7d1f-4353-bc31-3da4c0b51fcd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:07.370850 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41c3c2-7d1f-4353-bc31-3da4c0b51fcd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:07.384848 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224b948-9395-429f-9d8c-d658232988a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:07.385914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224b948-9395-429f-9d8c-d658232988a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:07.386237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224b948-9395-429f-9d8c-d658232988a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:07.386510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224b948-9395-429f-9d8c-d658232988a8 admin admin] PATH_INFO: `/v3/projects/f8a08453469e481d8031583de4309abc/users/17be1d8d35dd4850865cb4f151fa0954/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:07.414668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224b948-9395-429f-9d8c-d658232988a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a08453469e481d8031583de4309abc, user_id=17be1d8d35dd4850865cb4f151fa0954, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:07.418592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224b948-9395-429f-9d8c-d658232988a8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:07.440761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1190/2374] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:41:07 2022] PUT /identity/v3/projects/f8a08453469e481d8031583de4309abc/users/17be1d8d35dd4850865cb4f151fa0954/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:07.445489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599602d-7954-445f-a429-60a25caddf82 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:07.455943 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599602d-7954-445f-a429-60a25caddf82 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:07.532338 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa92378-1282-43d5-b817-e67597bb2995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:07.533056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa92378-1282-43d5-b817-e67597bb2995 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:07.534102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa92378-1282-43d5-b817-e67597bb2995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:07.534102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa92378-1282-43d5-b817-e67597bb2995 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:07.534385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa92378-1282-43d5-b817-e67597bb2995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:07.536045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa92378-1282-43d5-b817-e67597bb2995 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:07.550333 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1185/2375] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:41:07.553577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224b948-9395-429f-9d8c-d658232988a8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:07.569717 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224b948-9395-429f-9d8c-d658232988a8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:07.577838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebacfe4-1976-43eb-bd9b-44998b6ddf09 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:07.578376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebacfe4-1976-43eb-bd9b-44998b6ddf09 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:07.578819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebacfe4-1976-43eb-bd9b-44998b6ddf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:07.582194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c87cf-2ad9-486e-a3e8-7f31e2f1e59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:07.583377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c87cf-2ad9-486e-a3e8-7f31e2f1e59b admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:07.583720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c87cf-2ad9-486e-a3e8-7f31e2f1e59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:07.583933 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c87cf-2ad9-486e-a3e8-7f31e2f1e59b admin admin] PATH_INFO: `/v3/projects/f8a08453469e481d8031583de4309abc/users/17be1d8d35dd4850865cb4f151fa0954/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:07.586190 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c87cf-2ad9-486e-a3e8-7f31e2f1e59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a08453469e481d8031583de4309abc, user_id=17be1d8d35dd4850865cb4f151fa0954, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:07.588872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c87cf-2ad9-486e-a3e8-7f31e2f1e59b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:07.608309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1191/2376] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:41:07 2022] PUT /identity/v3/projects/f8a08453469e481d8031583de4309abc/users/17be1d8d35dd4850865cb4f151fa0954/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:07.621545 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2ebacfe4-1976-43eb-bd9b-44998b6ddf09 None None] MFA Rules not processed for user `a01201ddd64c4731992569cc38ca2276`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:07.622925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2ebacfe4-1976-43eb-bd9b-44998b6ddf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:07.714151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1186/2377] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:41:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:41:07.718691 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c87cf-2ad9-486e-a3e8-7f31e2f1e59b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:07.785276 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c87cf-2ad9-486e-a3e8-7f31e2f1e59b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:07.790515 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b494f3f-7bb3-4e34-b428-858198ed9306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:07.791204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b494f3f-7bb3-4e34-b428-858198ed9306 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:07.791490 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b494f3f-7bb3-4e34-b428-858198ed9306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:07.791762 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b494f3f-7bb3-4e34-b428-858198ed9306 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:07.792469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b494f3f-7bb3-4e34-b428-858198ed9306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:07.794483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b494f3f-7bb3-4e34-b428-858198ed9306 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:07.839207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1192/2378] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:41:07 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:41:07.843511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebacfe4-1976-43eb-bd9b-44998b6ddf09 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:07.857236 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebacfe4-1976-43eb-bd9b-44998b6ddf09 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:07.915455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30901e62-f31d-4ee3-9f87-f86dbc1c6df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:07.916117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30901e62-f31d-4ee3-9f87-f86dbc1c6df8 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:07.916416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30901e62-f31d-4ee3-9f87-f86dbc1c6df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:07.916670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30901e62-f31d-4ee3-9f87-f86dbc1c6df8 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:07.917367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30901e62-f31d-4ee3-9f87-f86dbc1c6df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:07.919336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30901e62-f31d-4ee3-9f87-f86dbc1c6df8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:07.943061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1187/2379] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:41:07 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:41:07.944712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b494f3f-7bb3-4e34-b428-858198ed9306 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:07.955225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b494f3f-7bb3-4e34-b428-858198ed9306 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:07.960107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae0e84-9522-4051-afe2-4a8374c33e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:07.960840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0e84-9522-4051-afe2-4a8374c33e7a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:07.961187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0e84-9522-4051-afe2-4a8374c33e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:07.961528 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0e84-9522-4051-afe2-4a8374c33e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:07.962369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae0e84-9522-4051-afe2-4a8374c33e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:07.964040 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae0e84-9522-4051-afe2-4a8374c33e7a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:07.981485 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1193/2380] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:41:07.986229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30901e62-f31d-4ee3-9f87-f86dbc1c6df8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:07.999296 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30901e62-f31d-4ee3-9f87-f86dbc1c6df8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:08.005006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b74f2a-dcb2-4085-9aa4-02c934f018d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:08.006244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b74f2a-dcb2-4085-9aa4-02c934f018d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:08.006606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b74f2a-dcb2-4085-9aa4-02c934f018d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:08.006954 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b74f2a-dcb2-4085-9aa4-02c934f018d3 admin admin] PATH_INFO: `/v3/projects/6425825058c64ef28ff75d9f98ca3039/users/e9cb832c2164492b877a7a6c33c9c173/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:08.024533 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b74f2a-dcb2-4085-9aa4-02c934f018d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6425825058c64ef28ff75d9f98ca3039, user_id=e9cb832c2164492b877a7a6c33c9c173, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:08.027844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b74f2a-dcb2-4085-9aa4-02c934f018d3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:08.048970 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1188/2381] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:41:07 2022] PUT /identity/v3/projects/6425825058c64ef28ff75d9f98ca3039/users/e9cb832c2164492b877a7a6c33c9c173/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:41:08.054419 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae0e84-9522-4051-afe2-4a8374c33e7a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:08.075985 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae0e84-9522-4051-afe2-4a8374c33e7a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:08.137468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807dd40-8142-4f25-81c2-e3d68c6ec4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:08.138558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807dd40-8142-4f25-81c2-e3d68c6ec4da admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:08.138861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807dd40-8142-4f25-81c2-e3d68c6ec4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:08.139127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807dd40-8142-4f25-81c2-e3d68c6ec4da admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:08.140000 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807dd40-8142-4f25-81c2-e3d68c6ec4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:08.141906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807dd40-8142-4f25-81c2-e3d68c6ec4da admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:08.155196 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1194/2382] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:41:08.159242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b74f2a-dcb2-4085-9aa4-02c934f018d3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:08.171197 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b74f2a-dcb2-4085-9aa4-02c934f018d3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:08.176175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a597e6e-f28f-4eb2-8df8-019c42636c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:08.177649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a597e6e-f28f-4eb2-8df8-019c42636c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:08.178115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a597e6e-f28f-4eb2-8df8-019c42636c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:08.178447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a597e6e-f28f-4eb2-8df8-019c42636c2e admin admin] PATH_INFO: `/v3/projects/6425825058c64ef28ff75d9f98ca3039/users/e9cb832c2164492b877a7a6c33c9c173/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:08.182134 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a597e6e-f28f-4eb2-8df8-019c42636c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6425825058c64ef28ff75d9f98ca3039, user_id=e9cb832c2164492b877a7a6c33c9c173, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:08.185491 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a597e6e-f28f-4eb2-8df8-019c42636c2e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:08.196509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1189/2383] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:41:08 2022] PUT /identity/v3/projects/6425825058c64ef28ff75d9f98ca3039/users/e9cb832c2164492b877a7a6c33c9c173/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:10.200850 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a29843-ad88-4882-8bd2-9d01336a04ca None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:10.201450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a29843-ad88-4882-8bd2-9d01336a04ca None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:10.201614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a29843-ad88-4882-8bd2-9d01336a04ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:10.227289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-e5a29843-ad88-4882-8bd2-9d01336a04ca None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:10.229614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e5a29843-ad88-4882-8bd2-9d01336a04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:10.357431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1195/2384] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:41:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:10.369374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a597e6e-f28f-4eb2-8df8-019c42636c2e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:10.371471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0a597e6e-f28f-4eb2-8df8-019c42636c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:10.401794 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a29843-ad88-4882-8bd2-9d01336a04ca None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:10.403752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-e5a29843-ad88-4882-8bd2-9d01336a04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:10.607093 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a29843-ad88-4882-8bd2-9d01336a04ca None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:10.615212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9e0e2-8f00-46ee-b6fb-ec155497ecc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:10.616097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9e0e2-8f00-46ee-b6fb-ec155497ecc8 service swift] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:10.616756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9e0e2-8f00-46ee-b6fb-ec155497ecc8 service swift] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:10.617049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9e0e2-8f00-46ee-b6fb-ec155497ecc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:10.627677 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9e0e2-8f00-46ee-b6fb-ec155497ecc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:10.641275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9e0e2-8f00-46ee-b6fb-ec155497ecc8 service swift] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:10.642163 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a597e6e-f28f-4eb2-8df8-019c42636c2e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:10.653050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1196/2385] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:41:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:41:10.658749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaaf34-4d81-4f02-aebf-93335eaf4271 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02e7385005924d4f8c220c986b9866de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:10.659524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaaf34-4d81-4f02-aebf-93335eaf4271 service placement] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:10.659886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaaf34-4d81-4f02-aebf-93335eaf4271 service placement] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:10.660234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaaf34-4d81-4f02-aebf-93335eaf4271 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:10.662452 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-1cfaaf34-4d81-4f02-aebf-93335eaf4271 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:10.689613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfaaf34-4d81-4f02-aebf-93335eaf4271 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:10.691513 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfaaf34-4d81-4f02-aebf-93335eaf4271 service placement] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:10.727934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1190/2386] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:41:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:41:16.196725 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96427b6f-b1d9-4c91-a44b-3524450f014e None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:16.198027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96427b6f-b1d9-4c91-a44b-3524450f014e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:16.198027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96427b6f-b1d9-4c91-a44b-3524450f014e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:16.252483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-96427b6f-b1d9-4c91-a44b-3524450f014e None None] MFA Rules not processed for user `17be1d8d35dd4850865cb4f151fa0954`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:16.253886 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-96427b6f-b1d9-4c91-a44b-3524450f014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:16.357449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1197/2387] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:41:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:16.369603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaaf34-4d81-4f02-aebf-93335eaf4271 service placement] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:16.372113 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-1cfaaf34-4d81-4f02-aebf-93335eaf4271 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:16.623309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaaf34-4d81-4f02-aebf-93335eaf4271 service placement] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:16.643052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf9c16-53c6-4536-8fc1-36d120d6676c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:16.645615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf9c16-53c6-4536-8fc1-36d120d6676c service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:16.646164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf9c16-53c6-4536-8fc1-36d120d6676c service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:16.648076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf9c16-53c6-4536-8fc1-36d120d6676c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:16.831395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf9c16-53c6-4536-8fc1-36d120d6676c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:16.835157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf9c16-53c6-4536-8fc1-36d120d6676c service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:16.892921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1191/2388] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:41:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:41:18.947084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae4737-6aee-43cf-912b-3ec80046d0c5 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:18.948478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae4737-6aee-43cf-912b-3ec80046d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:18.948914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae4737-6aee-43cf-912b-3ec80046d0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:19.020824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-fcae4737-6aee-43cf-912b-3ec80046d0c5 None None] MFA Rules not processed for user `e9cb832c2164492b877a7a6c33c9c173`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:19.022085 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fcae4737-6aee-43cf-912b-3ec80046d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:19.157822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1198/2389] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:41:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:19.308259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf9c16-53c6-4536-8fc1-36d120d6676c service nova] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:19.321073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf9c16-53c6-4536-8fc1-36d120d6676c service nova] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:19.345201 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bec8a-0f5a-4284-ae43-6f93e65303cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:19.345884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bec8a-0f5a-4284-ae43-6f93e65303cb service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:19.346172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bec8a-0f5a-4284-ae43-6f93e65303cb service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:19.346478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bec8a-0f5a-4284-ae43-6f93e65303cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:19.527479 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bec8a-0f5a-4284-ae43-6f93e65303cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:19.529184 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bec8a-0f5a-4284-ae43-6f93e65303cb service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:19.580318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1192/2390] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:41:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:41:24.450403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2feceb-7541-4531-ae67-814397ceb31c None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:24.451352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2feceb-7541-4531-ae67-814397ceb31c None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:24.451804 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2feceb-7541-4531-ae67-814397ceb31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:24.505332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-fc2feceb-7541-4531-ae67-814397ceb31c None None] MFA Rules not processed for user `a01201ddd64c4731992569cc38ca2276`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:24.514783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fc2feceb-7541-4531-ae67-814397ceb31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:24.553921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1199/2391] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:41:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:41.076090 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985cf3-6e7a-4e89-bc16-c018fdbc56a6 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:41.077176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985cf3-6e7a-4e89-bc16-c018fdbc56a6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:41.077612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985cf3-6e7a-4e89-bc16-c018fdbc56a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:41.152844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-eb985cf3-6e7a-4e89-bc16-c018fdbc56a6 None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:41.154054 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-eb985cf3-6e7a-4e89-bc16-c018fdbc56a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:41.173176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1193/2392] 10.222.0.79 () {58 vars in 967 bytes} [Mon Feb 21 01:41:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Feb 21 01:41:41.187188 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2feceb-7541-4531-ae67-814397ceb31c None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:41.215552 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2feceb-7541-4531-ae67-814397ceb31c None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:41.220813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e445-6b92-4038-8f6e-ce499e8155e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:41.221574 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e445-6b92-4038-8f6e-ce499e8155e4 service swift] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:41.222017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e445-6b92-4038-8f6e-ce499e8155e4 service swift] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:41.222428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e445-6b92-4038-8f6e-ce499e8155e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:41.231777 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871e445-6b92-4038-8f6e-ce499e8155e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:41.233460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871e445-6b92-4038-8f6e-ce499e8155e4 service swift] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:41.242784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1200/2393] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:41:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:41:45.890655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923ab79-e3f7-4be1-bc27-40d03d4a9ae5 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:45.891187 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923ab79-e3f7-4be1-bc27-40d03d4a9ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:45.891364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923ab79-e3f7-4be1-bc27-40d03d4a9ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:45.909441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2923ab79-e3f7-4be1-bc27-40d03d4a9ae5 None None] MFA Rules not processed for user `d40b20a8c16d4771b4410f975e9f2a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:45.910654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2923ab79-e3f7-4be1-bc27-40d03d4a9ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:45.917466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1194/2394] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:41:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:51.420794 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e445-6b92-4038-8f6e-ce499e8155e4 service swift] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:51.422918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1871e445-6b92-4038-8f6e-ce499e8155e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:51.499886 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e445-6b92-4038-8f6e-ce499e8155e4 service swift] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:51.505158 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c493b-a7b2-4c34-9a51-695d6897c153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:51.506031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c493b-a7b2-4c34-9a51-695d6897c153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:51.506348 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c493b-a7b2-4c34-9a51-695d6897c153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:51.506623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c493b-a7b2-4c34-9a51-695d6897c153 admin admin] PATH_INFO: `/v3/users/2675a53d6286472895674a3be54131b7` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:51.507821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c493b-a7b2-4c34-9a51-695d6897c153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2675a53d6286472895674a3be54131b7)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:51.510138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c493b-a7b2-4c34-9a51-695d6897c153 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:51.561273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-088c493b-a7b2-4c34-9a51-695d6897c153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2675a53d6286472895674a3be54131b7'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:51.569923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-088c493b-a7b2-4c34-9a51-695d6897c153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2675a53d6286472895674a3be54131b7'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:51.584607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-088c493b-a7b2-4c34-9a51-695d6897c153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2675a53d6286472895674a3be54131b7'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:51.585384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-088c493b-a7b2-4c34-9a51-695d6897c153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2675a53d6286472895674a3be54131b7'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:51.595473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-088c493b-a7b2-4c34-9a51-695d6897c153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2675a53d6286472895674a3be54131b7'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:51.602180 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1201/2395] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:41:51 2022] DELETE /identity/v3/users/2675a53d6286472895674a3be54131b7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:51.986611 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923ab79-e3f7-4be1-bc27-40d03d4a9ae5 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:52.007428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923ab79-e3f7-4be1-bc27-40d03d4a9ae5 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:52.089306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586516ee-ad1c-4fd7-ac35-1425f71a7893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:52.090601 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586516ee-ad1c-4fd7-ac35-1425f71a7893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:52.091082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586516ee-ad1c-4fd7-ac35-1425f71a7893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:52.091455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586516ee-ad1c-4fd7-ac35-1425f71a7893 admin admin] PATH_INFO: `/v3/projects/3f4a571f17fa4430ba044ac2106e41b1` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:52.093554 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586516ee-ad1c-4fd7-ac35-1425f71a7893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4a571f17fa4430ba044ac2106e41b1)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:52.095627 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586516ee-ad1c-4fd7-ac35-1425f71a7893 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:52.149171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-586516ee-ad1c-4fd7-ac35-1425f71a7893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4a571f17fa4430ba044ac2106e41b1', 'request_id': 'req-586516ee-ad1c-4fd7-ac35-1425f71a7893'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:52.156291 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-586516ee-ad1c-4fd7-ac35-1425f71a7893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4a571f17fa4430ba044ac2106e41b1', 'request_id': 'req-586516ee-ad1c-4fd7-ac35-1425f71a7893'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:52.165385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-586516ee-ad1c-4fd7-ac35-1425f71a7893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4a571f17fa4430ba044ac2106e41b1', 'request_id': 'req-586516ee-ad1c-4fd7-ac35-1425f71a7893'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:52.177755 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-586516ee-ad1c-4fd7-ac35-1425f71a7893 admin admin] The token cache is being invalidate because project 3f4a571f17fa4430ba044ac2106e41b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:41:52.178043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-586516ee-ad1c-4fd7-ac35-1425f71a7893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:52.178898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-586516ee-ad1c-4fd7-ac35-1425f71a7893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:52.180656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1195/2396] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:41:51 2022] DELETE /identity/v3/projects/3f4a571f17fa4430ba044ac2106e41b1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:52.185684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33028a4b-51d4-4223-bff2-9202dc74acd3 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:52.185982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33028a4b-51d4-4223-bff2-9202dc74acd3 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:52.186286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33028a4b-51d4-4223-bff2-9202dc74acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:52.206566 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-33028a4b-51d4-4223-bff2-9202dc74acd3 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:52.207733 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-33028a4b-51d4-4223-bff2-9202dc74acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:52.270345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1202/2397] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:52.278607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a508d98-118f-4cb0-b16f-e93bf5d6ec65 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:52.278899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a508d98-118f-4cb0-b16f-e93bf5d6ec65 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:52.279459 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a508d98-118f-4cb0-b16f-e93bf5d6ec65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:52.299301 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-9a508d98-118f-4cb0-b16f-e93bf5d6ec65 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:52.301056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9a508d98-118f-4cb0-b16f-e93bf5d6ec65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:52.308890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1196/2398] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:52.313126 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33028a4b-51d4-4223-bff2-9202dc74acd3 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:52.322774 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33028a4b-51d4-4223-bff2-9202dc74acd3 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:52.327354 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a445e0-bf7c-4fbf-930b-e436d36328c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:52.328301 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a445e0-bf7c-4fbf-930b-e436d36328c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:52.328584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a445e0-bf7c-4fbf-930b-e436d36328c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:52.328857 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a445e0-bf7c-4fbf-930b-e436d36328c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:52.329585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a445e0-bf7c-4fbf-930b-e436d36328c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:41:52.329889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a445e0-bf7c-4fbf-930b-e436d36328c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:52.331648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a445e0-bf7c-4fbf-930b-e436d36328c7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:52.348830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1203/2399] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:41:52.349696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a508d98-118f-4cb0-b16f-e93bf5d6ec65 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:52.358871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a508d98-118f-4cb0-b16f-e93bf5d6ec65 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:52.364615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759edc24-53a8-4bb4-9165-1d4cabe3e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:52.365269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759edc24-53a8-4bb4-9165-1d4cabe3e8be admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:52.365678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759edc24-53a8-4bb4-9165-1d4cabe3e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:52.365957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759edc24-53a8-4bb4-9165-1d4cabe3e8be admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:52.366985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759edc24-53a8-4bb4-9165-1d4cabe3e8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:52.368868 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759edc24-53a8-4bb4-9165-1d4cabe3e8be admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:52.396446 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1197/2400] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:41:52 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:41:52.400624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a445e0-bf7c-4fbf-930b-e436d36328c7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:52.411623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a445e0-bf7c-4fbf-930b-e436d36328c7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:52.488777 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28904f-f787-4232-b314-ebdc006dbf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:52.489481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28904f-f787-4232-b314-ebdc006dbf6a admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:52.489851 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28904f-f787-4232-b314-ebdc006dbf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:52.490121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28904f-f787-4232-b314-ebdc006dbf6a admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:52.490909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28904f-f787-4232-b314-ebdc006dbf6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:52.496661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28904f-f787-4232-b314-ebdc006dbf6a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:52.532298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1204/2401] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:41:52 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:41:52.533500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759edc24-53a8-4bb4-9165-1d4cabe3e8be admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:52.556073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759edc24-53a8-4bb4-9165-1d4cabe3e8be admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:52.563119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adb82e-305d-4471-8202-c6a6c2329f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:52.563957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adb82e-305d-4471-8202-c6a6c2329f32 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:52.564122 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adb82e-305d-4471-8202-c6a6c2329f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:52.566908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adb82e-305d-4471-8202-c6a6c2329f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:52.567692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adb82e-305d-4471-8202-c6a6c2329f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:52.570623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adb82e-305d-4471-8202-c6a6c2329f32 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:52.583354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1198/2402] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:41:52.587363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28904f-f787-4232-b314-ebdc006dbf6a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:52.601356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28904f-f787-4232-b314-ebdc006dbf6a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:52.606869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e7423-1b30-4c12-b2bd-9ed9b5ca8612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:52.607554 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e7423-1b30-4c12-b2bd-9ed9b5ca8612 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:52.607836 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e7423-1b30-4c12-b2bd-9ed9b5ca8612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:52.608109 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e7423-1b30-4c12-b2bd-9ed9b5ca8612 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:52.608883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e7423-1b30-4c12-b2bd-9ed9b5ca8612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:52.610705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e7423-1b30-4c12-b2bd-9ed9b5ca8612 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:52.622525 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1205/2403] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:41:52.626642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adb82e-305d-4471-8202-c6a6c2329f32 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:52.637075 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adb82e-305d-4471-8202-c6a6c2329f32 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:52.642238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45607c-ca02-480c-a705-2c2a2d99411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:52.643927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45607c-ca02-480c-a705-2c2a2d99411c admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:52.644221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45607c-ca02-480c-a705-2c2a2d99411c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:52.644501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45607c-ca02-480c-a705-2c2a2d99411c admin admin] PATH_INFO: `/v3/projects/5ca5c5b0a31c4953bbf4498ebb21bbe9/users/0f3ec7d1035d4cd69ed8f21ff17ace87/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:52.660983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45607c-ca02-480c-a705-2c2a2d99411c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca5c5b0a31c4953bbf4498ebb21bbe9, user_id=0f3ec7d1035d4cd69ed8f21ff17ace87, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:52.663565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45607c-ca02-480c-a705-2c2a2d99411c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:52.689641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1199/2404] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:41:52 2022] PUT /identity/v3/projects/5ca5c5b0a31c4953bbf4498ebb21bbe9/users/0f3ec7d1035d4cd69ed8f21ff17ace87/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:52.691544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e300325-a8e5-4164-ab8b-bb8f34341950 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:52.691820 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e300325-a8e5-4164-ab8b-bb8f34341950 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:52.692113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e300325-a8e5-4164-ab8b-bb8f34341950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:52.719504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-6e300325-a8e5-4164-ab8b-bb8f34341950 None None] MFA Rules not processed for user `0f3ec7d1035d4cd69ed8f21ff17ace87`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:52.720696 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6e300325-a8e5-4164-ab8b-bb8f34341950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:52.790419 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1206/2405] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:41:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:52.801485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45607c-ca02-480c-a705-2c2a2d99411c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:52.803957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-1e45607c-ca02-480c-a705-2c2a2d99411c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:52.909124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45607c-ca02-480c-a705-2c2a2d99411c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:52.912867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6296be-731c-49c3-9a21-7cb9aea594e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:52.913519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6296be-731c-49c3-9a21-7cb9aea594e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:52.913801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6296be-731c-49c3-9a21-7cb9aea594e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:52.914077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6296be-731c-49c3-9a21-7cb9aea594e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:52.922695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6296be-731c-49c3-9a21-7cb9aea594e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:52.924138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6296be-731c-49c3-9a21-7cb9aea594e1 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:52.933785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1200/2406] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:41:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:42:08.656952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e300325-a8e5-4164-ab8b-bb8f34341950 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:08.658426 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6e300325-a8e5-4164-ab8b-bb8f34341950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:08.715017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e300325-a8e5-4164-ab8b-bb8f34341950 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:08.718570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b329c7d-ba19-452c-9213-b928c514657f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:08.719220 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b329c7d-ba19-452c-9213-b928c514657f service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:08.719501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b329c7d-ba19-452c-9213-b928c514657f service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:08.719773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b329c7d-ba19-452c-9213-b928c514657f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:08.721556 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-1b329c7d-ba19-452c-9213-b928c514657f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:08.784824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b329c7d-ba19-452c-9213-b928c514657f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:08.788952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b329c7d-ba19-452c-9213-b928c514657f service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:08.800212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1207/2407] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:12.233519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6296be-731c-49c3-9a21-7cb9aea594e1 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:12.293997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6296be-731c-49c3-9a21-7cb9aea594e1 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:12.298623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:12.299488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:12.299900 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:12.300074 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] PATH_INFO: `/v3/users/0f3ec7d1035d4cd69ed8f21ff17ace87` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:12.301289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3ec7d1035d4cd69ed8f21ff17ace87)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:12.303256 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:12.352780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3ec7d1035d4cd69ed8f21ff17ace87'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:12.359538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3ec7d1035d4cd69ed8f21ff17ace87'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:12.371129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3ec7d1035d4cd69ed8f21ff17ace87'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:12.371855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3ec7d1035d4cd69ed8f21ff17ace87'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:12.372485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3ec7d1035d4cd69ed8f21ff17ace87'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:12.386237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1201/2408] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:12 2022] DELETE /identity/v3/users/0f3ec7d1035d4cd69ed8f21ff17ace87 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:12.390706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bc255-8ffd-4fb8-a7b7-a552d70c85a3 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:12.391270 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bc255-8ffd-4fb8-a7b7-a552d70c85a3 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:12.391383 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bc255-8ffd-4fb8-a7b7-a552d70c85a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:12.409055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-ae7bc255-8ffd-4fb8-a7b7-a552d70c85a3 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:12.410277 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ae7bc255-8ffd-4fb8-a7b7-a552d70c85a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:12.427725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:12.429193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:12.468219 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1208/2409] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:12.477573 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bc255-8ffd-4fb8-a7b7-a552d70c85a3 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:12.484389 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042555a-85f7-43c5-b2a4-4096157ade94 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:12.486455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bc255-8ffd-4fb8-a7b7-a552d70c85a3 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:12.488397 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcf55e-5c9c-4258-baae-248eeec0e748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:12.489102 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcf55e-5c9c-4258-baae-248eeec0e748 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:12.489384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcf55e-5c9c-4258-baae-248eeec0e748 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:12.489663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcf55e-5c9c-4258-baae-248eeec0e748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:12.490110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a6849-849a-4062-8c9f-91ef723acaff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:12.491050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a6849-849a-4062-8c9f-91ef723acaff service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:12.491328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a6849-849a-4062-8c9f-91ef723acaff service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:12.491599 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a6849-849a-4062-8c9f-91ef723acaff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:12.491781 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-96dcf55e-5c9c-4258-baae-248eeec0e748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:12.500343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a6849-849a-4062-8c9f-91ef723acaff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:12.502274 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a6849-849a-4062-8c9f-91ef723acaff service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:12.513438 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1209/2410] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:42:12.554507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcf55e-5c9c-4258-baae-248eeec0e748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:12.555979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcf55e-5c9c-4258-baae-248eeec0e748 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:12.566321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1202/2411] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:42:12.884442 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a6849-849a-4062-8c9f-91ef723acaff service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:12.885875 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6f4a6849-849a-4062-8c9f-91ef723acaff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:12.900128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a6849-849a-4062-8c9f-91ef723acaff service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:12.905584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:12.907157 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:12.907510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:12.907851 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] PATH_INFO: `/v3/projects/5ca5c5b0a31c4953bbf4498ebb21bbe9` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:12.909154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca5c5b0a31c4953bbf4498ebb21bbe9)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:12.911711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:12.968475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca5c5b0a31c4953bbf4498ebb21bbe9', 'request_id': 'req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:12.974426 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca5c5b0a31c4953bbf4498ebb21bbe9', 'request_id': 'req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:12.983313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca5c5b0a31c4953bbf4498ebb21bbe9', 'request_id': 'req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.008984 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] The token cache is being invalidate because project 5ca5c5b0a31c4953bbf4498ebb21bbe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:13.009300 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.009973 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.011568 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1210/2412] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:12 2022] DELETE /identity/v3/projects/5ca5c5b0a31c4953bbf4498ebb21bbe9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:31.523206 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcf55e-5c9c-4258-baae-248eeec0e748 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:31.524731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-96dcf55e-5c9c-4258-baae-248eeec0e748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:31.543323 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcf55e-5c9c-4258-baae-248eeec0e748 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:31.606684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6b2ed-8bc9-479b-a714-c7bb8c014efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:31.607556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6b2ed-8bc9-479b-a714-c7bb8c014efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:31.607838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6b2ed-8bc9-479b-a714-c7bb8c014efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:31.608117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6b2ed-8bc9-479b-a714-c7bb8c014efb admin admin] PATH_INFO: `/v3/users/64a37cb9bd2847ee8ec6124cea770c90` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:31.609310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6b2ed-8bc9-479b-a714-c7bb8c014efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=64a37cb9bd2847ee8ec6124cea770c90)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:31.611305 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6b2ed-8bc9-479b-a714-c7bb8c014efb admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:31.659012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-cdd6b2ed-8bc9-479b-a714-c7bb8c014efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64a37cb9bd2847ee8ec6124cea770c90'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:31.666269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-cdd6b2ed-8bc9-479b-a714-c7bb8c014efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64a37cb9bd2847ee8ec6124cea770c90'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:31.678568 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-cdd6b2ed-8bc9-479b-a714-c7bb8c014efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64a37cb9bd2847ee8ec6124cea770c90'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:31.679356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-cdd6b2ed-8bc9-479b-a714-c7bb8c014efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64a37cb9bd2847ee8ec6124cea770c90'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:31.680101 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-cdd6b2ed-8bc9-479b-a714-c7bb8c014efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64a37cb9bd2847ee8ec6124cea770c90'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:31.692800 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1203/2413] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:31 2022] DELETE /identity/v3/users/64a37cb9bd2847ee8ec6124cea770c90 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:31.869613 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:31.871219 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:31.884693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbefdc2-7b87-4b0d-9bf8-e79da82f23af admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:31.943200 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:31.944057 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:31.944337 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:31.944602 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a admin admin] PATH_INFO: `/v3/projects/1d5b71bc1bf2467dada53f1eb9447438` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:31.945971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5b71bc1bf2467dada53f1eb9447438)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:31.947904 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:31.992383 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5b71bc1bf2467dada53f1eb9447438', 'request_id': 'req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:31.997761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5b71bc1bf2467dada53f1eb9447438', 'request_id': 'req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:32.005473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5b71bc1bf2467dada53f1eb9447438', 'request_id': 'req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:32.016227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a admin admin] The token cache is being invalidate because project 1d5b71bc1bf2467dada53f1eb9447438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:32.017129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:32.017749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ac2e5bcd-e168-4f48-9a60-10d28dbfb62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:32.019312 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1211/2414] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:31 2022] DELETE /identity/v3/projects/1d5b71bc1bf2467dada53f1eb9447438 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:32.024361 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8460696-bdc2-4ae1-bdf6-e2d9e4e8d478 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:32.024656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8460696-bdc2-4ae1-bdf6-e2d9e4e8d478 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:32.024934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8460696-bdc2-4ae1-bdf6-e2d9e4e8d478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:32.042680 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e8460696-bdc2-4ae1-bdf6-e2d9e4e8d478 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:32.043766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e8460696-bdc2-4ae1-bdf6-e2d9e4e8d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:32.101641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1204/2415] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:32.109195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b2822-95f2-47c4-89c8-afba5c21dd83 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:32.109568 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b2822-95f2-47c4-89c8-afba5c21dd83 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:32.109911 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b2822-95f2-47c4-89c8-afba5c21dd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:32.128530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b40b2822-95f2-47c4-89c8-afba5c21dd83 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:32.129783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b40b2822-95f2-47c4-89c8-afba5c21dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:32.138285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1212/2416] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:32.142892 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8460696-bdc2-4ae1-bdf6-e2d9e4e8d478 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:32.152241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8460696-bdc2-4ae1-bdf6-e2d9e4e8d478 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:32.156775 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb09f-79d6-49fd-854a-b79dd0b68ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:32.157450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb09f-79d6-49fd-854a-b79dd0b68ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:32.157734 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb09f-79d6-49fd-854a-b79dd0b68ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:32.158010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb09f-79d6-49fd-854a-b79dd0b68ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:32.158765 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb09f-79d6-49fd-854a-b79dd0b68ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:42:32.159071 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb09f-79d6-49fd-854a-b79dd0b68ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:32.160657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb09f-79d6-49fd-854a-b79dd0b68ccb admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:32.172021 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1205/2417] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:42:32.176538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b2822-95f2-47c4-89c8-afba5c21dd83 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:32.185515 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b2822-95f2-47c4-89c8-afba5c21dd83 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:32.190742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3064-74eb-4b00-a441-dd6208e8e559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:32.191375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3064-74eb-4b00-a441-dd6208e8e559 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:32.191654 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3064-74eb-4b00-a441-dd6208e8e559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:32.191922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3064-74eb-4b00-a441-dd6208e8e559 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:32.192614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3064-74eb-4b00-a441-dd6208e8e559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:32.194514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3064-74eb-4b00-a441-dd6208e8e559 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:32.219551 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1213/2418] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:32 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:32.223855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb09f-79d6-49fd-854a-b79dd0b68ccb admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:32.233720 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb09f-79d6-49fd-854a-b79dd0b68ccb admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:32.287965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc409934-719d-48de-8dd3-13547e1eab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:32.288618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409934-719d-48de-8dd3-13547e1eab0d admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:32.288900 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409934-719d-48de-8dd3-13547e1eab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:32.289172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409934-719d-48de-8dd3-13547e1eab0d admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:32.289844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc409934-719d-48de-8dd3-13547e1eab0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:32.291806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc409934-719d-48de-8dd3-13547e1eab0d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:32.311275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1206/2419] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:32 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:42:32.316043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3064-74eb-4b00-a441-dd6208e8e559 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:32.326002 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3064-74eb-4b00-a441-dd6208e8e559 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:32.330640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb918d00-d05d-4059-ba77-5a2dfe6a57df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:32.331291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb918d00-d05d-4059-ba77-5a2dfe6a57df admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:32.331575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb918d00-d05d-4059-ba77-5a2dfe6a57df admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:32.331851 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb918d00-d05d-4059-ba77-5a2dfe6a57df admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:32.332566 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb918d00-d05d-4059-ba77-5a2dfe6a57df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:32.334153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb918d00-d05d-4059-ba77-5a2dfe6a57df admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:32.344241 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1214/2420] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:32.348045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc409934-719d-48de-8dd3-13547e1eab0d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:32.358118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc409934-719d-48de-8dd3-13547e1eab0d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:32.363233 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021709b-2c47-4dc7-bf4a-dcba8d553f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:32.363884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021709b-2c47-4dc7-bf4a-dcba8d553f6f admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:32.364169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021709b-2c47-4dc7-bf4a-dcba8d553f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:32.364455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021709b-2c47-4dc7-bf4a-dcba8d553f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:32.365176 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021709b-2c47-4dc7-bf4a-dcba8d553f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:32.367081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021709b-2c47-4dc7-bf4a-dcba8d553f6f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:32.377244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1207/2421] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:32.381238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb918d00-d05d-4059-ba77-5a2dfe6a57df admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:32.390832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb918d00-d05d-4059-ba77-5a2dfe6a57df admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:32.395526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05568a81-6dc7-42bb-8bbb-2eb589aaeb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:32.396675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05568a81-6dc7-42bb-8bbb-2eb589aaeb76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:32.396960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05568a81-6dc7-42bb-8bbb-2eb589aaeb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:32.397230 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05568a81-6dc7-42bb-8bbb-2eb589aaeb76 admin admin] PATH_INFO: `/v3/projects/21caeb0e5202480e9632abdbed4978e3/users/de5d1f395bf848dda44fe58d2fceeec5/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:32.411137 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05568a81-6dc7-42bb-8bbb-2eb589aaeb76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21caeb0e5202480e9632abdbed4978e3, user_id=de5d1f395bf848dda44fe58d2fceeec5, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:32.413747 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05568a81-6dc7-42bb-8bbb-2eb589aaeb76 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:32.427042 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1215/2422] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:32 2022] PUT /identity/v3/projects/21caeb0e5202480e9632abdbed4978e3/users/de5d1f395bf848dda44fe58d2fceeec5/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:32.436937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82bbdf-2620-4ae4-8007-9706b3035fec None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:32.437252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82bbdf-2620-4ae4-8007-9706b3035fec None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:32.437533 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82bbdf-2620-4ae4-8007-9706b3035fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:32.463383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2d82bbdf-2620-4ae4-8007-9706b3035fec None None] MFA Rules not processed for user `de5d1f395bf848dda44fe58d2fceeec5`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:32.464565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2d82bbdf-2620-4ae4-8007-9706b3035fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:32.525013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1208/2423] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:32.536051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05568a81-6dc7-42bb-8bbb-2eb589aaeb76 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:32.537798 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-05568a81-6dc7-42bb-8bbb-2eb589aaeb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:32.608976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05568a81-6dc7-42bb-8bbb-2eb589aaeb76 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:32.615096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17ff45-f32b-4302-b15b-048ced486987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:32.615986 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ff45-f32b-4302-b15b-048ced486987 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:32.616268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ff45-f32b-4302-b15b-048ced486987 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:32.616545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ff45-f32b-4302-b15b-048ced486987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:32.624156 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17ff45-f32b-4302-b15b-048ced486987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:32.626292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17ff45-f32b-4302-b15b-048ced486987 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:32.634939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1216/2424] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:32.803263 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82bbdf-2620-4ae4-8007-9706b3035fec None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:32.863743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82bbdf-2620-4ae4-8007-9706b3035fec None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:32.868458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:32.869322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:32.869603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:32.869878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] PATH_INFO: `/v3/users/de5d1f395bf848dda44fe58d2fceeec5` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:32.871094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5d1f395bf848dda44fe58d2fceeec5)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:32.873026 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:32.918288 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5d1f395bf848dda44fe58d2fceeec5'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:32.925465 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5d1f395bf848dda44fe58d2fceeec5'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:32.936757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5d1f395bf848dda44fe58d2fceeec5'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:32.937444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5d1f395bf848dda44fe58d2fceeec5'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:32.938056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5d1f395bf848dda44fe58d2fceeec5'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:32.950473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1209/2425] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:32 2022] DELETE /identity/v3/users/de5d1f395bf848dda44fe58d2fceeec5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:32.955575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e41c71-7e8e-4143-9b5e-7a8269d1e25f None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:32.956054 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e41c71-7e8e-4143-9b5e-7a8269d1e25f None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:32.956174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e41c71-7e8e-4143-9b5e-7a8269d1e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:32.973230 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-61e41c71-7e8e-4143-9b5e-7a8269d1e25f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:32.974445 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-61e41c71-7e8e-4143-9b5e-7a8269d1e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:33.030876 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1217/2426] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:42:33.041020 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:33.042504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:33.111551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04592381-19b8-41fe-9426-fd624259b81f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:33.115771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def24c7-70a9-492a-a0d2-52879a681c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:33.116390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def24c7-70a9-492a-a0d2-52879a681c1b service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:33.116823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def24c7-70a9-492a-a0d2-52879a681c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:33.117251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def24c7-70a9-492a-a0d2-52879a681c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:33.126739 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def24c7-70a9-492a-a0d2-52879a681c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:33.128211 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def24c7-70a9-492a-a0d2-52879a681c1b service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:33.138035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1210/2427] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:33.399900 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e41c71-7e8e-4143-9b5e-7a8269d1e25f None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:33.401334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-61e41c71-7e8e-4143-9b5e-7a8269d1e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:33.414745 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e41c71-7e8e-4143-9b5e-7a8269d1e25f None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:33.419697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff87ec-2acd-4714-b9c6-ce6d94b8183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:33.420585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff87ec-2acd-4714-b9c6-ce6d94b8183e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:33.420864 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff87ec-2acd-4714-b9c6-ce6d94b8183e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:33.421136 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff87ec-2acd-4714-b9c6-ce6d94b8183e admin admin] PATH_INFO: `/v3/projects/21caeb0e5202480e9632abdbed4978e3` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:33.422483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff87ec-2acd-4714-b9c6-ce6d94b8183e admin admin] RBAC: Authorizing `identity:delete_project(project_id=21caeb0e5202480e9632abdbed4978e3)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:33.424343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff87ec-2acd-4714-b9c6-ce6d94b8183e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:33.469915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-edff87ec-2acd-4714-b9c6-ce6d94b8183e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21caeb0e5202480e9632abdbed4978e3', 'request_id': 'req-edff87ec-2acd-4714-b9c6-ce6d94b8183e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:33.475115 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-edff87ec-2acd-4714-b9c6-ce6d94b8183e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21caeb0e5202480e9632abdbed4978e3', 'request_id': 'req-edff87ec-2acd-4714-b9c6-ce6d94b8183e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:33.482774 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-edff87ec-2acd-4714-b9c6-ce6d94b8183e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21caeb0e5202480e9632abdbed4978e3', 'request_id': 'req-edff87ec-2acd-4714-b9c6-ce6d94b8183e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:33.494191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-edff87ec-2acd-4714-b9c6-ce6d94b8183e admin admin] The token cache is being invalidate because project 21caeb0e5202480e9632abdbed4978e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:33.494500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-edff87ec-2acd-4714-b9c6-ce6d94b8183e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:33.495129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-edff87ec-2acd-4714-b9c6-ce6d94b8183e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:33.496633 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1218/2428] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:33 2022] DELETE /identity/v3/projects/21caeb0e5202480e9632abdbed4978e3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:33.501958 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a6f73-7599-4b70-9f69-07968f03d435 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:33.502276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a6f73-7599-4b70-9f69-07968f03d435 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:33.502553 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a6f73-7599-4b70-9f69-07968f03d435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:33.520362 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-4c0a6f73-7599-4b70-9f69-07968f03d435 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:33.521521 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-4c0a6f73-7599-4b70-9f69-07968f03d435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:33.575596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1211/2429] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:33.584603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9cb92-4e25-4311-bdde-0b7f9e31788e None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:33.584893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9cb92-4e25-4311-bdde-0b7f9e31788e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:33.585172 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9cb92-4e25-4311-bdde-0b7f9e31788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:33.605244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-14d9cb92-4e25-4311-bdde-0b7f9e31788e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:33.606464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-14d9cb92-4e25-4311-bdde-0b7f9e31788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:33.614256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1219/2430] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:33.618724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a6f73-7599-4b70-9f69-07968f03d435 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:33.628537 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a6f73-7599-4b70-9f69-07968f03d435 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:33.633251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dc8f2-c40d-4f6d-8d76-ecadcb2f4b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:33.633930 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dc8f2-c40d-4f6d-8d76-ecadcb2f4b74 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:33.634234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dc8f2-c40d-4f6d-8d76-ecadcb2f4b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:33.634512 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dc8f2-c40d-4f6d-8d76-ecadcb2f4b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:33.635234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dc8f2-c40d-4f6d-8d76-ecadcb2f4b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:42:33.635537 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dc8f2-c40d-4f6d-8d76-ecadcb2f4b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:33.637152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dc8f2-c40d-4f6d-8d76-ecadcb2f4b74 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:33.648948 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1212/2431] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:42:33.652967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9cb92-4e25-4311-bdde-0b7f9e31788e None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:33.661898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9cb92-4e25-4311-bdde-0b7f9e31788e None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:33.666585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a35aa2-4238-4714-9ed5-84c278329c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:33.667248 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a35aa2-4238-4714-9ed5-84c278329c62 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:33.667532 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a35aa2-4238-4714-9ed5-84c278329c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:33.667807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a35aa2-4238-4714-9ed5-84c278329c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:33.668499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a35aa2-4238-4714-9ed5-84c278329c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:33.670452 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a35aa2-4238-4714-9ed5-84c278329c62 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:33.695728 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1220/2432] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:33 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:33.699917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dc8f2-c40d-4f6d-8d76-ecadcb2f4b74 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:33.709434 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dc8f2-c40d-4f6d-8d76-ecadcb2f4b74 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:33.763852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56db0b-c975-4ecf-a446-2434ca3ba976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:33.764448 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56db0b-c975-4ecf-a446-2434ca3ba976 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:33.764729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56db0b-c975-4ecf-a446-2434ca3ba976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:33.765005 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56db0b-c975-4ecf-a446-2434ca3ba976 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:33.765694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56db0b-c975-4ecf-a446-2434ca3ba976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:33.767640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56db0b-c975-4ecf-a446-2434ca3ba976 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:33.787759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1213/2433] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:33 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:33.791925 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a35aa2-4238-4714-9ed5-84c278329c62 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:33.802512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a35aa2-4238-4714-9ed5-84c278329c62 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:33.807082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9f96d-0323-462a-8bea-7bdcfeec9a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:33.807721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f96d-0323-462a-8bea-7bdcfeec9a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:33.807998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f96d-0323-462a-8bea-7bdcfeec9a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:33.808269 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f96d-0323-462a-8bea-7bdcfeec9a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:33.808989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9f96d-0323-462a-8bea-7bdcfeec9a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:33.810625 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9f96d-0323-462a-8bea-7bdcfeec9a36 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:33.821582 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1221/2434] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:33.825488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56db0b-c975-4ecf-a446-2434ca3ba976 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:33.835089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56db0b-c975-4ecf-a446-2434ca3ba976 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:33.839624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43da825-8732-4f0f-9ef6-25d9cae456ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:33.840268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43da825-8732-4f0f-9ef6-25d9cae456ed admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:33.840549 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43da825-8732-4f0f-9ef6-25d9cae456ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:33.840821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43da825-8732-4f0f-9ef6-25d9cae456ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:33.841531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43da825-8732-4f0f-9ef6-25d9cae456ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:33.843139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43da825-8732-4f0f-9ef6-25d9cae456ed admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:33.852545 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1214/2435] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:33.856485 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9f96d-0323-462a-8bea-7bdcfeec9a36 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:33.866893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9f96d-0323-462a-8bea-7bdcfeec9a36 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:33.871440 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea149e-aa9f-4b20-9bc9-f2713f4a86ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:33.872291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea149e-aa9f-4b20-9bc9-f2713f4a86ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:33.872569 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea149e-aa9f-4b20-9bc9-f2713f4a86ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:33.872842 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea149e-aa9f-4b20-9bc9-f2713f4a86ad admin admin] PATH_INFO: `/v3/projects/de6d967fcc5e4f6aab3f02286c8f70b1/users/a545ad3e063644ff83a2dcd912956476/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:33.888314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea149e-aa9f-4b20-9bc9-f2713f4a86ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6d967fcc5e4f6aab3f02286c8f70b1, user_id=a545ad3e063644ff83a2dcd912956476, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:33.890961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea149e-aa9f-4b20-9bc9-f2713f4a86ad admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:33.903511 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1222/2436] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:33 2022] PUT /identity/v3/projects/de6d967fcc5e4f6aab3f02286c8f70b1/users/a545ad3e063644ff83a2dcd912956476/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:33.913505 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0b397-a70a-4f44-8cc2-192068981640 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:33.913791 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0b397-a70a-4f44-8cc2-192068981640 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:33.914119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0b397-a70a-4f44-8cc2-192068981640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:33.941210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-95a0b397-a70a-4f44-8cc2-192068981640 None None] MFA Rules not processed for user `a545ad3e063644ff83a2dcd912956476`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:33.942455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-95a0b397-a70a-4f44-8cc2-192068981640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:34.002805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1215/2437] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:42:34.007203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea149e-aa9f-4b20-9bc9-f2713f4a86ad admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:34.065136 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea149e-aa9f-4b20-9bc9-f2713f4a86ad admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:34.069771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff927b1-86b6-4474-af09-5497814087e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:34.070438 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff927b1-86b6-4474-af09-5497814087e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:34.070718 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff927b1-86b6-4474-af09-5497814087e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:34.070986 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff927b1-86b6-4474-af09-5497814087e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:34.071660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff927b1-86b6-4474-af09-5497814087e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:34.073535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff927b1-86b6-4474-af09-5497814087e5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:34.098547 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1223/2438] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:34 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:34.102338 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0b397-a70a-4f44-8cc2-192068981640 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:34.113423 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0b397-a70a-4f44-8cc2-192068981640 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:34.166914 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd472b77-8427-4016-9476-a90e1f03a5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:34.167497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd472b77-8427-4016-9476-a90e1f03a5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:34.167778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd472b77-8427-4016-9476-a90e1f03a5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:34.168052 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd472b77-8427-4016-9476-a90e1f03a5d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:34.168737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd472b77-8427-4016-9476-a90e1f03a5d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:34.170674 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd472b77-8427-4016-9476-a90e1f03a5d0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:34.190159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1216/2439] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:34 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:34.194096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff927b1-86b6-4474-af09-5497814087e5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:34.204023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff927b1-86b6-4474-af09-5497814087e5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:34.208562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c864c8-f069-482e-8619-6e51ca4527c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:34.209204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c864c8-f069-482e-8619-6e51ca4527c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:34.209486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c864c8-f069-482e-8619-6e51ca4527c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:34.209765 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c864c8-f069-482e-8619-6e51ca4527c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:34.210594 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c864c8-f069-482e-8619-6e51ca4527c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:34.212187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c864c8-f069-482e-8619-6e51ca4527c7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:34.223142 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1224/2440] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:34.227241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd472b77-8427-4016-9476-a90e1f03a5d0 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:34.237811 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd472b77-8427-4016-9476-a90e1f03a5d0 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:34.243007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734cb89-259f-4e8c-86e1-d9a7f6badcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:34.243908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734cb89-259f-4e8c-86e1-d9a7f6badcfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:34.244305 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734cb89-259f-4e8c-86e1-d9a7f6badcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:34.244584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734cb89-259f-4e8c-86e1-d9a7f6badcfe admin admin] PATH_INFO: `/v3/projects/c60383b829e94472b8abaae0f2a53b76/users/001270c04a8741e383a32abf76003953/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:34.258937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734cb89-259f-4e8c-86e1-d9a7f6badcfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60383b829e94472b8abaae0f2a53b76, user_id=001270c04a8741e383a32abf76003953, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:34.261561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734cb89-259f-4e8c-86e1-d9a7f6badcfe admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:34.276649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1217/2441] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:34 2022] PUT /identity/v3/projects/c60383b829e94472b8abaae0f2a53b76/users/001270c04a8741e383a32abf76003953/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:34.279022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c864c8-f069-482e-8619-6e51ca4527c7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:34.289106 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c864c8-f069-482e-8619-6e51ca4527c7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:34.343746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3d4fd-191c-40ca-9c77-cbeb92dbe96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:34.345046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3d4fd-191c-40ca-9c77-cbeb92dbe96a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:34.345343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3d4fd-191c-40ca-9c77-cbeb92dbe96a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:34.345616 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3d4fd-191c-40ca-9c77-cbeb92dbe96a admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:34.346375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3d4fd-191c-40ca-9c77-cbeb92dbe96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:34.347966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3d4fd-191c-40ca-9c77-cbeb92dbe96a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:34.357675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1225/2442] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:34.362453 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734cb89-259f-4e8c-86e1-d9a7f6badcfe admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:34.373158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734cb89-259f-4e8c-86e1-d9a7f6badcfe admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:34.377952 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c395687-041d-4e57-980b-407dc3162bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:34.378868 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c395687-041d-4e57-980b-407dc3162bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:34.379153 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c395687-041d-4e57-980b-407dc3162bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:34.379428 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c395687-041d-4e57-980b-407dc3162bc3 admin admin] PATH_INFO: `/v3/projects/c60383b829e94472b8abaae0f2a53b76/users/001270c04a8741e383a32abf76003953/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:34.381466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c395687-041d-4e57-980b-407dc3162bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60383b829e94472b8abaae0f2a53b76, user_id=001270c04a8741e383a32abf76003953, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:34.384129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c395687-041d-4e57-980b-407dc3162bc3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:34.394258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1218/2443] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:34 2022] PUT /identity/v3/projects/c60383b829e94472b8abaae0f2a53b76/users/001270c04a8741e383a32abf76003953/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:34.404270 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc777b-fcb7-4ab4-8f38-0575fac82670 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:34.404561 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc777b-fcb7-4ab4-8f38-0575fac82670 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:34.404823 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc777b-fcb7-4ab4-8f38-0575fac82670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:34.431884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-3bdc777b-fcb7-4ab4-8f38-0575fac82670 None None] MFA Rules not processed for user `001270c04a8741e383a32abf76003953`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:34.433182 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3bdc777b-fcb7-4ab4-8f38-0575fac82670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:34.503360 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1226/2444] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:34.517256 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c395687-041d-4e57-980b-407dc3162bc3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:34.519063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8c395687-041d-4e57-980b-407dc3162bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:34.577274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c395687-041d-4e57-980b-407dc3162bc3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:34.581700 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc813b58-52c6-4c53-8eb4-0b13daf26639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:34.582393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc813b58-52c6-4c53-8eb4-0b13daf26639 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:34.582726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc813b58-52c6-4c53-8eb4-0b13daf26639 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:34.582938 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc813b58-52c6-4c53-8eb4-0b13daf26639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:34.591969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc813b58-52c6-4c53-8eb4-0b13daf26639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:34.593377 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc813b58-52c6-4c53-8eb4-0b13daf26639 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:34.603034 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1219/2445] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:34.881412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc777b-fcb7-4ab4-8f38-0575fac82670 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:34.890195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc777b-fcb7-4ab4-8f38-0575fac82670 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:34.895321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6fba8-6e4b-4090-aac9-e33d7df769d3 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '001270c04a8741e383a32abf76003953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c60383b829e94472b8abaae0f2a53b76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:34.895965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6fba8-6e4b-4090-aac9-e33d7df769d3 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:34.896247 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6fba8-6e4b-4090-aac9-e33d7df769d3 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:34.896521 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6fba8-6e4b-4090-aac9-e33d7df769d3 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:34.897230 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6fba8-6e4b-4090-aac9-e33d7df769d3 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:42:34.897535 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6fba8-6e4b-4090-aac9-e33d7df769d3 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:34.899155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6fba8-6e4b-4090-aac9-e33d7df769d3 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:34.910130 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1227/2446] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:42:34.913989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc813b58-52c6-4c53-8eb4-0b13daf26639 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:34.923025 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc813b58-52c6-4c53-8eb4-0b13daf26639 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:34.927533 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4de94c-9707-49e6-a448-a6ea003ee5f0 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '001270c04a8741e383a32abf76003953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c60383b829e94472b8abaae0f2a53b76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:34.928213 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4de94c-9707-49e6-a448-a6ea003ee5f0 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:34.928504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4de94c-9707-49e6-a448-a6ea003ee5f0 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:34.928782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4de94c-9707-49e6-a448-a6ea003ee5f0 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:34.929466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4de94c-9707-49e6-a448-a6ea003ee5f0 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:34.931374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4de94c-9707-49e6-a448-a6ea003ee5f0 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:34.958616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1220/2447] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:34 2022] POST /identity/v3/projects => generated 355 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:42:34.959698 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6fba8-6e4b-4090-aac9-e33d7df769d3 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:34.970356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6fba8-6e4b-4090-aac9-e33d7df769d3 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:35.025450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2ec40-b5b0-4a71-ab34-287ee263a6c6 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '001270c04a8741e383a32abf76003953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c60383b829e94472b8abaae0f2a53b76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:35.026183 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2ec40-b5b0-4a71-ab34-287ee263a6c6 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:35.026534 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2ec40-b5b0-4a71-ab34-287ee263a6c6 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:35.026813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2ec40-b5b0-4a71-ab34-287ee263a6c6 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:35.027562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2ec40-b5b0-4a71-ab34-287ee263a6c6 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:42:35.027872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2ec40-b5b0-4a71-ab34-287ee263a6c6 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:35.029462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2ec40-b5b0-4a71-ab34-287ee263a6c6 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:35.040693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1228/2448] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:42:35.075321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4de94c-9707-49e6-a448-a6ea003ee5f0 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:35.086018 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4de94c-9707-49e6-a448-a6ea003ee5f0 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:35.090867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb5799-ce28-483c-851c-acae6efc6678 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '001270c04a8741e383a32abf76003953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c60383b829e94472b8abaae0f2a53b76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:35.091722 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb5799-ce28-483c-851c-acae6efc6678 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:35.092005 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb5799-ce28-483c-851c-acae6efc6678 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:35.092279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb5799-ce28-483c-851c-acae6efc6678 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] PATH_INFO: `/v3/projects/05951a00d15c4f1a8879fc8fe9b1faac` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:35.093480 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb5799-ce28-483c-851c-acae6efc6678 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05951a00d15c4f1a8879fc8fe9b1faac)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:35.095551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb5799-ce28-483c-851c-acae6efc6678 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:35.141024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4dbb5799-ce28-483c-851c-acae6efc6678 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05951a00d15c4f1a8879fc8fe9b1faac', 'request_id': 'req-4dbb5799-ce28-483c-851c-acae6efc6678'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:35.149168 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4dbb5799-ce28-483c-851c-acae6efc6678 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05951a00d15c4f1a8879fc8fe9b1faac', 'request_id': 'req-4dbb5799-ce28-483c-851c-acae6efc6678'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:35.156417 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4dbb5799-ce28-483c-851c-acae6efc6678 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05951a00d15c4f1a8879fc8fe9b1faac', 'request_id': 'req-4dbb5799-ce28-483c-851c-acae6efc6678'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:35.166296 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4dbb5799-ce28-483c-851c-acae6efc6678 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] The token cache is being invalidate because project 05951a00d15c4f1a8879fc8fe9b1faac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:35.166605 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4dbb5799-ce28-483c-851c-acae6efc6678 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:35.167255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4dbb5799-ce28-483c-851c-acae6efc6678 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:35.168771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1221/2449] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:35 2022] DELETE /identity/v3/projects/05951a00d15c4f1a8879fc8fe9b1faac => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:35.348286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2ec40-b5b0-4a71-ab34-287ee263a6c6 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:35.350396 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5be2ec40-b5b0-4a71-ab34-287ee263a6c6 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:35.414412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2ec40-b5b0-4a71-ab34-287ee263a6c6 tempest-VolumeQuotaClassesTest-982564180 tempest-VolumeQuotaClassesTest-982564180-project-admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:35.467078 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:35.467932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:35.468216 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:35.468491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] PATH_INFO: `/v3/users/a545ad3e063644ff83a2dcd912956476` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:35.469662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a545ad3e063644ff83a2dcd912956476)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:35.471600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:35.515971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a545ad3e063644ff83a2dcd912956476'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:35.522741 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a545ad3e063644ff83a2dcd912956476'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:35.533991 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a545ad3e063644ff83a2dcd912956476'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:35.534589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a545ad3e063644ff83a2dcd912956476'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:35.541171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a545ad3e063644ff83a2dcd912956476'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:35.546956 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1229/2450] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:35 2022] DELETE /identity/v3/users/a545ad3e063644ff83a2dcd912956476 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:35.551867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7d44e-a0f4-4292-9f44-b687a1ca7b6f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:35.552151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7d44e-a0f4-4292-9f44-b687a1ca7b6f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:35.552426 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7d44e-a0f4-4292-9f44-b687a1ca7b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:35.570171 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-a5a7d44e-a0f4-4292-9f44-b687a1ca7b6f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:35.571386 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a5a7d44e-a0f4-4292-9f44-b687a1ca7b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:35.628693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1222/2451] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:35.639593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:35.641099 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:35.701295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d893856-be13-40fc-98dd-a1783e541379 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:35.705072 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f97bb8-b7a0-4ebc-aa11-80204d9e676c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:35.705715 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f97bb8-b7a0-4ebc-aa11-80204d9e676c service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:35.705997 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f97bb8-b7a0-4ebc-aa11-80204d9e676c service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:35.706790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f97bb8-b7a0-4ebc-aa11-80204d9e676c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:35.715412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f97bb8-b7a0-4ebc-aa11-80204d9e676c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:35.716840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f97bb8-b7a0-4ebc-aa11-80204d9e676c service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:35.728256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1230/2452] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:36.049374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7d44e-a0f4-4292-9f44-b687a1ca7b6f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:36.050820 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a5a7d44e-a0f4-4292-9f44-b687a1ca7b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:36.062405 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7d44e-a0f4-4292-9f44-b687a1ca7b6f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:36.067375 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:36.068259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:36.068535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:36.068802 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] PATH_INFO: `/v3/projects/de6d967fcc5e4f6aab3f02286c8f70b1` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:36.069960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6d967fcc5e4f6aab3f02286c8f70b1)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:36.071877 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:36.118300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6d967fcc5e4f6aab3f02286c8f70b1', 'request_id': 'req-8733f50b-13c7-44ec-b880-6873943c5708'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.124326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6d967fcc5e4f6aab3f02286c8f70b1', 'request_id': 'req-8733f50b-13c7-44ec-b880-6873943c5708'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.131610 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6d967fcc5e4f6aab3f02286c8f70b1', 'request_id': 'req-8733f50b-13c7-44ec-b880-6873943c5708'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.142048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] The token cache is being invalidate because project de6d967fcc5e4f6aab3f02286c8f70b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:36.142362 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.142979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.144477 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1223/2453] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:36 2022] DELETE /identity/v3/projects/de6d967fcc5e4f6aab3f02286c8f70b1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:36.148465 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f97bb8-b7a0-4ebc-aa11-80204d9e676c service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:36.158828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f97bb8-b7a0-4ebc-aa11-80204d9e676c service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:36.212279 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a148f2-4498-49b0-b3f5-e3edc0fd001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:36.213133 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a148f2-4498-49b0-b3f5-e3edc0fd001d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:36.213415 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a148f2-4498-49b0-b3f5-e3edc0fd001d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:36.213688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a148f2-4498-49b0-b3f5-e3edc0fd001d admin admin] PATH_INFO: `/v3/users/001270c04a8741e383a32abf76003953` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:36.214873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a148f2-4498-49b0-b3f5-e3edc0fd001d admin admin] RBAC: Authorizing `identity:delete_user(user_id=001270c04a8741e383a32abf76003953)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:36.216796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a148f2-4498-49b0-b3f5-e3edc0fd001d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:36.261275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a8a148f2-4498-49b0-b3f5-e3edc0fd001d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001270c04a8741e383a32abf76003953'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.267811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a8a148f2-4498-49b0-b3f5-e3edc0fd001d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001270c04a8741e383a32abf76003953'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.279199 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a8a148f2-4498-49b0-b3f5-e3edc0fd001d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001270c04a8741e383a32abf76003953'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.279828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a8a148f2-4498-49b0-b3f5-e3edc0fd001d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001270c04a8741e383a32abf76003953'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.286325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a8a148f2-4498-49b0-b3f5-e3edc0fd001d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001270c04a8741e383a32abf76003953'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.292046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1231/2454] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:36 2022] DELETE /identity/v3/users/001270c04a8741e383a32abf76003953 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:36.552797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:36.554354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:36.568051 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733f50b-13c7-44ec-b880-6873943c5708 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:36.623279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efc94c-17ba-498b-9f31-ac7f45759e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:36.624157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc94c-17ba-498b-9f31-ac7f45759e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:36.624439 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc94c-17ba-498b-9f31-ac7f45759e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:36.624712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc94c-17ba-498b-9f31-ac7f45759e2c admin admin] PATH_INFO: `/v3/projects/c60383b829e94472b8abaae0f2a53b76` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:36.625877 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efc94c-17ba-498b-9f31-ac7f45759e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60383b829e94472b8abaae0f2a53b76)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:36.627807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efc94c-17ba-498b-9f31-ac7f45759e2c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:36.670981 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-28efc94c-17ba-498b-9f31-ac7f45759e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60383b829e94472b8abaae0f2a53b76', 'request_id': 'req-28efc94c-17ba-498b-9f31-ac7f45759e2c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.677569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-28efc94c-17ba-498b-9f31-ac7f45759e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60383b829e94472b8abaae0f2a53b76', 'request_id': 'req-28efc94c-17ba-498b-9f31-ac7f45759e2c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.684485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-28efc94c-17ba-498b-9f31-ac7f45759e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60383b829e94472b8abaae0f2a53b76', 'request_id': 'req-28efc94c-17ba-498b-9f31-ac7f45759e2c'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.694358 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-28efc94c-17ba-498b-9f31-ac7f45759e2c admin admin] The token cache is being invalidate because project c60383b829e94472b8abaae0f2a53b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:36.694641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-28efc94c-17ba-498b-9f31-ac7f45759e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.695251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-28efc94c-17ba-498b-9f31-ac7f45759e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:36.696757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1224/2455] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:36 2022] DELETE /identity/v3/projects/c60383b829e94472b8abaae0f2a53b76 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:36.701767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696941c1-47f9-4594-816b-b2d400bb401d None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:36.702098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696941c1-47f9-4594-816b-b2d400bb401d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:36.702400 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696941c1-47f9-4594-816b-b2d400bb401d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:36.723731 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-696941c1-47f9-4594-816b-b2d400bb401d None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:36.725313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-696941c1-47f9-4594-816b-b2d400bb401d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:36.785929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1232/2456] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:36.793702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00f8a4-3254-4fa4-b770-60d33846cb0a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:36.793987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00f8a4-3254-4fa4-b770-60d33846cb0a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:36.794297 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00f8a4-3254-4fa4-b770-60d33846cb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:36.812436 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-8b00f8a4-3254-4fa4-b770-60d33846cb0a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:36.814279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8b00f8a4-3254-4fa4-b770-60d33846cb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:36.821910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1225/2457] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:36.826020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696941c1-47f9-4594-816b-b2d400bb401d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:36.835366 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696941c1-47f9-4594-816b-b2d400bb401d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:36.839896 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d99585-f242-455a-a9c3-46f90cee6ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:36.840531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d99585-f242-455a-a9c3-46f90cee6ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:36.840809 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d99585-f242-455a-a9c3-46f90cee6ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:36.841078 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d99585-f242-455a-a9c3-46f90cee6ec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:36.841790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d99585-f242-455a-a9c3-46f90cee6ec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:42:36.842089 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d99585-f242-455a-a9c3-46f90cee6ec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:36.843709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d99585-f242-455a-a9c3-46f90cee6ec3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:36.854729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1233/2458] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:42:36.858910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00f8a4-3254-4fa4-b770-60d33846cb0a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:36.868780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00f8a4-3254-4fa4-b770-60d33846cb0a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:36.873466 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d01c1a-9efa-46e9-99a9-62bb114bc547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:36.874103 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01c1a-9efa-46e9-99a9-62bb114bc547 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:36.874426 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01c1a-9efa-46e9-99a9-62bb114bc547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:36.874702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01c1a-9efa-46e9-99a9-62bb114bc547 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:36.875385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d01c1a-9efa-46e9-99a9-62bb114bc547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:36.877974 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d01c1a-9efa-46e9-99a9-62bb114bc547 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:36.902495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1226/2459] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:36 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:36.906532 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d99585-f242-455a-a9c3-46f90cee6ec3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:36.916167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d99585-f242-455a-a9c3-46f90cee6ec3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:36.969421 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e8529-5187-407b-9eec-1d0b221cb8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:36.970075 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e8529-5187-407b-9eec-1d0b221cb8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:36.970386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e8529-5187-407b-9eec-1d0b221cb8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:36.970663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e8529-5187-407b-9eec-1d0b221cb8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:36.971344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e8529-5187-407b-9eec-1d0b221cb8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:36.973246 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e8529-5187-407b-9eec-1d0b221cb8a0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:36.995959 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1234/2460] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:36 2022] POST /identity/v3/users => generated 295 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:36.997012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d01c1a-9efa-46e9-99a9-62bb114bc547 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:37.007499 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d01c1a-9efa-46e9-99a9-62bb114bc547 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:37.012081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164a397-806a-4bae-93bd-acdc6961abf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:37.012735 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164a397-806a-4bae-93bd-acdc6961abf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:37.013012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164a397-806a-4bae-93bd-acdc6961abf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:37.013280 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164a397-806a-4bae-93bd-acdc6961abf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:37.013995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164a397-806a-4bae-93bd-acdc6961abf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:37.015736 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164a397-806a-4bae-93bd-acdc6961abf6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:37.027215 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1227/2461] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:37.031391 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e8529-5187-407b-9eec-1d0b221cb8a0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:37.042357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e8529-5187-407b-9eec-1d0b221cb8a0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:37.047148 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5bf30-80e4-4b7f-ac33-3b2dc7132f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:37.047837 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5bf30-80e4-4b7f-ac33-3b2dc7132f28 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:37.048132 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5bf30-80e4-4b7f-ac33-3b2dc7132f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:37.048410 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5bf30-80e4-4b7f-ac33-3b2dc7132f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:37.049140 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5bf30-80e4-4b7f-ac33-3b2dc7132f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:37.050775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5bf30-80e4-4b7f-ac33-3b2dc7132f28 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:37.064357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1235/2462] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:37.065617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164a397-806a-4bae-93bd-acdc6961abf6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:37.081407 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164a397-806a-4bae-93bd-acdc6961abf6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:37.098130 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2e14f-4681-4261-bf18-06baed8141fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:37.099162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2e14f-4681-4261-bf18-06baed8141fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:37.099535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2e14f-4681-4261-bf18-06baed8141fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:37.099894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2e14f-4681-4261-bf18-06baed8141fb admin admin] PATH_INFO: `/v3/projects/1201ba0d4b4d4337a18223817971a95c/users/549faf2405854fd4815e00ad9f9272cd/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:37.116976 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2e14f-4681-4261-bf18-06baed8141fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1201ba0d4b4d4337a18223817971a95c, user_id=549faf2405854fd4815e00ad9f9272cd, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:37.119867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2e14f-4681-4261-bf18-06baed8141fb admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:37.133696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1228/2463] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:37 2022] PUT /identity/v3/projects/1201ba0d4b4d4337a18223817971a95c/users/549faf2405854fd4815e00ad9f9272cd/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:37.144549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fec9-57c5-4b62-8192-747ba13741c9 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:37.144836 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fec9-57c5-4b62-8192-747ba13741c9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:37.145115 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fec9-57c5-4b62-8192-747ba13741c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:37.171796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-3ac6fec9-57c5-4b62-8192-747ba13741c9 None None] MFA Rules not processed for user `549faf2405854fd4815e00ad9f9272cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:37.173080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3ac6fec9-57c5-4b62-8192-747ba13741c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:37.233477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1236/2464] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:37.238801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2e14f-4681-4261-bf18-06baed8141fb admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:37.297469 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2e14f-4681-4261-bf18-06baed8141fb admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:37.301996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea707b87-ee1b-46c0-9cc0-82735f55e8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:37.302692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea707b87-ee1b-46c0-9cc0-82735f55e8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:37.302971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea707b87-ee1b-46c0-9cc0-82735f55e8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:37.303241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea707b87-ee1b-46c0-9cc0-82735f55e8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:37.303929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea707b87-ee1b-46c0-9cc0-82735f55e8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:37.305807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea707b87-ee1b-46c0-9cc0-82735f55e8d1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:37.330670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1229/2465] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:37 2022] POST /identity/v3/projects => generated 389 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:37.334613 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fec9-57c5-4b62-8192-747ba13741c9 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:37.344962 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fec9-57c5-4b62-8192-747ba13741c9 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:37.399835 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b1992-d835-4e3b-9b53-59755ff1d1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:37.400492 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b1992-d835-4e3b-9b53-59755ff1d1de admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:37.400770 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b1992-d835-4e3b-9b53-59755ff1d1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:37.401040 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b1992-d835-4e3b-9b53-59755ff1d1de admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:37.401843 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b1992-d835-4e3b-9b53-59755ff1d1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:37.403770 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b1992-d835-4e3b-9b53-59755ff1d1de admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:37.423394 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1237/2466] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:37 2022] POST /identity/v3/users => generated 301 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:37.427422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea707b87-ee1b-46c0-9cc0-82735f55e8d1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:37.437522 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea707b87-ee1b-46c0-9cc0-82735f55e8d1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:37.442654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5c240-8893-4578-9fef-0150d891d5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:37.443297 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5c240-8893-4578-9fef-0150d891d5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:37.443580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5c240-8893-4578-9fef-0150d891d5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:37.443850 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5c240-8893-4578-9fef-0150d891d5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:37.444584 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5c240-8893-4578-9fef-0150d891d5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:37.446164 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5c240-8893-4578-9fef-0150d891d5a0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:37.456123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1230/2467] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:42:37.459984 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b1992-d835-4e3b-9b53-59755ff1d1de admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:37.469702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b1992-d835-4e3b-9b53-59755ff1d1de admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:37.474273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b91c61-7db6-4c54-bf38-4dac2e4df4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:37.475109 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b91c61-7db6-4c54-bf38-4dac2e4df4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:37.475392 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b91c61-7db6-4c54-bf38-4dac2e4df4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:37.475665 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b91c61-7db6-4c54-bf38-4dac2e4df4f7 admin admin] PATH_INFO: `/v3/projects/8e5f6fc27c3049a29ad00fa67a4a048f/users/0b7493f89c564ff5bb0a4860fb3dc96f/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:37.490378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b91c61-7db6-4c54-bf38-4dac2e4df4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5f6fc27c3049a29ad00fa67a4a048f, user_id=0b7493f89c564ff5bb0a4860fb3dc96f, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:37.493328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b91c61-7db6-4c54-bf38-4dac2e4df4f7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:37.507760 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1238/2468] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:37 2022] PUT /identity/v3/projects/8e5f6fc27c3049a29ad00fa67a4a048f/users/0b7493f89c564ff5bb0a4860fb3dc96f/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:37.511649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5c240-8893-4578-9fef-0150d891d5a0 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:37.521438 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5c240-8893-4578-9fef-0150d891d5a0 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:37.575092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130a707-c0eb-4bba-99a2-1e975652cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:37.575756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130a707-c0eb-4bba-99a2-1e975652cde4 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:37.576040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130a707-c0eb-4bba-99a2-1e975652cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:37.576315 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130a707-c0eb-4bba-99a2-1e975652cde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:37.577028 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130a707-c0eb-4bba-99a2-1e975652cde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:37.578651 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130a707-c0eb-4bba-99a2-1e975652cde4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:37.587886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1231/2469] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:37.591890 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b91c61-7db6-4c54-bf38-4dac2e4df4f7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:37.601971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b91c61-7db6-4c54-bf38-4dac2e4df4f7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:37.606648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ec237-78ef-4c49-9fb2-ca2cd40f7e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:37.607524 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ec237-78ef-4c49-9fb2-ca2cd40f7e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:37.607799 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ec237-78ef-4c49-9fb2-ca2cd40f7e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:37.608067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ec237-78ef-4c49-9fb2-ca2cd40f7e40 admin admin] PATH_INFO: `/v3/projects/8e5f6fc27c3049a29ad00fa67a4a048f/users/0b7493f89c564ff5bb0a4860fb3dc96f/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:37.610034 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ec237-78ef-4c49-9fb2-ca2cd40f7e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5f6fc27c3049a29ad00fa67a4a048f, user_id=0b7493f89c564ff5bb0a4860fb3dc96f, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:37.613232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ec237-78ef-4c49-9fb2-ca2cd40f7e40 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:37.624076 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1239/2470] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:37 2022] PUT /identity/v3/projects/8e5f6fc27c3049a29ad00fa67a4a048f/users/0b7493f89c564ff5bb0a4860fb3dc96f/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:37.635717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6535d-9b7d-4036-9ec8-db06c55481d1 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:37.636011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6535d-9b7d-4036-9ec8-db06c55481d1 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:37.636288 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6535d-9b7d-4036-9ec8-db06c55481d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:37.662394 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-90a6535d-9b7d-4036-9ec8-db06c55481d1 None None] MFA Rules not processed for user `0b7493f89c564ff5bb0a4860fb3dc96f`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:37.663581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-90a6535d-9b7d-4036-9ec8-db06c55481d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:37.730420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1232/2471] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:37.740355 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ec237-78ef-4c49-9fb2-ca2cd40f7e40 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:37.742554 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ed6ec237-78ef-4c49-9fb2-ca2cd40f7e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:37.799335 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ec237-78ef-4c49-9fb2-ca2cd40f7e40 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:37.803137 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a740c2-4e89-4a24-a5e4-f0e0ab4e6e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:37.803776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a740c2-4e89-4a24-a5e4-f0e0ab4e6e82 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:37.804054 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a740c2-4e89-4a24-a5e4-f0e0ab4e6e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:37.804325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a740c2-4e89-4a24-a5e4-f0e0ab4e6e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:37.814339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a740c2-4e89-4a24-a5e4-f0e0ab4e6e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:37.815810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a740c2-4e89-4a24-a5e4-f0e0ab4e6e82 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:37.825517 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1240/2472] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:37.945235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6535d-9b7d-4036-9ec8-db06c55481d1 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:38.005059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6535d-9b7d-4036-9ec8-db06c55481d1 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:38.009581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:38.010484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:38.010766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:38.011035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] PATH_INFO: `/v3/users/549faf2405854fd4815e00ad9f9272cd` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:38.012217 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549faf2405854fd4815e00ad9f9272cd)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:38.014139 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:38.060213 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549faf2405854fd4815e00ad9f9272cd'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.067179 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549faf2405854fd4815e00ad9f9272cd'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.079551 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549faf2405854fd4815e00ad9f9272cd'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.080271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549faf2405854fd4815e00ad9f9272cd'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.080871 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549faf2405854fd4815e00ad9f9272cd'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.099454 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1233/2473] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:37 2022] DELETE /identity/v3/users/549faf2405854fd4815e00ad9f9272cd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:38.103859 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c14a54-c555-466a-ab27-0ef43284ece2 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:38.104150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c14a54-c555-466a-ab27-0ef43284ece2 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:38.104425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c14a54-c555-466a-ab27-0ef43284ece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:38.122563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-96c14a54-c555-466a-ab27-0ef43284ece2 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:38.123733 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-96c14a54-c555-466a-ab27-0ef43284ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:38.181986 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1241/2474] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:38.191411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:38.192897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:38.254677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e65a76-5db7-4f22-8793-e872dbce2ae1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:38.258228 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f87e-36d2-4896-995c-3cf5e8f68cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:38.258870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f87e-36d2-4896-995c-3cf5e8f68cfc service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:38.259152 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f87e-36d2-4896-995c-3cf5e8f68cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:38.259426 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f87e-36d2-4896-995c-3cf5e8f68cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:38.268916 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9f87e-36d2-4896-995c-3cf5e8f68cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:38.270389 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9f87e-36d2-4896-995c-3cf5e8f68cfc service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:38.279703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1234/2475] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:38.696836 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c14a54-c555-466a-ab27-0ef43284ece2 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:38.698463 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-96c14a54-c555-466a-ab27-0ef43284ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:38.717311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c14a54-c555-466a-ab27-0ef43284ece2 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:38.723996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:38.724878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:38.725227 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:38.725507 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] PATH_INFO: `/v3/projects/1201ba0d4b4d4337a18223817971a95c` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:38.726879 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1201ba0d4b4d4337a18223817971a95c)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:38.729082 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:38.779631 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1201ba0d4b4d4337a18223817971a95c', 'request_id': 'req-a1165e91-2569-461b-a899-0ddf88955192'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.786079 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1201ba0d4b4d4337a18223817971a95c', 'request_id': 'req-a1165e91-2569-461b-a899-0ddf88955192'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.795015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1201ba0d4b4d4337a18223817971a95c', 'request_id': 'req-a1165e91-2569-461b-a899-0ddf88955192'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.806932 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] The token cache is being invalidate because project 1201ba0d4b4d4337a18223817971a95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:38.807222 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.807889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.809454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1242/2476] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:38 2022] DELETE /identity/v3/projects/1201ba0d4b4d4337a18223817971a95c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:38.814133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f87e-36d2-4896-995c-3cf5e8f68cfc service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:38.824741 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f87e-36d2-4896-995c-3cf5e8f68cfc service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:38.884041 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7eed9-508a-4f32-9c07-5fc689963995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:38.884964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7eed9-508a-4f32-9c07-5fc689963995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:38.885244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7eed9-508a-4f32-9c07-5fc689963995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:38.885513 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7eed9-508a-4f32-9c07-5fc689963995 admin admin] PATH_INFO: `/v3/users/0b7493f89c564ff5bb0a4860fb3dc96f` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:38.886785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7eed9-508a-4f32-9c07-5fc689963995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7493f89c564ff5bb0a4860fb3dc96f)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:38.888738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7eed9-508a-4f32-9c07-5fc689963995 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:38.937758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d9f7eed9-508a-4f32-9c07-5fc689963995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7493f89c564ff5bb0a4860fb3dc96f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.945484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d9f7eed9-508a-4f32-9c07-5fc689963995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7493f89c564ff5bb0a4860fb3dc96f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.957264 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d9f7eed9-508a-4f32-9c07-5fc689963995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7493f89c564ff5bb0a4860fb3dc96f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.958029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d9f7eed9-508a-4f32-9c07-5fc689963995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7493f89c564ff5bb0a4860fb3dc96f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.958644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d9f7eed9-508a-4f32-9c07-5fc689963995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7493f89c564ff5bb0a4860fb3dc96f'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:38.972325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1235/2477] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:38 2022] DELETE /identity/v3/users/0b7493f89c564ff5bb0a4860fb3dc96f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:39.298917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:39.300499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:39.317957 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165e91-2569-461b-a899-0ddf88955192 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:39.377989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4aec7-eb88-4fed-979e-9a05d1a77108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:39.378961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4aec7-eb88-4fed-979e-9a05d1a77108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:39.379314 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4aec7-eb88-4fed-979e-9a05d1a77108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:39.379655 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4aec7-eb88-4fed-979e-9a05d1a77108 admin admin] PATH_INFO: `/v3/projects/8e5f6fc27c3049a29ad00fa67a4a048f` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:39.380898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4aec7-eb88-4fed-979e-9a05d1a77108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5f6fc27c3049a29ad00fa67a4a048f)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:39.383076 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4aec7-eb88-4fed-979e-9a05d1a77108 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:39.431796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0dc4aec7-eb88-4fed-979e-9a05d1a77108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5f6fc27c3049a29ad00fa67a4a048f', 'request_id': 'req-0dc4aec7-eb88-4fed-979e-9a05d1a77108'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:39.437495 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0dc4aec7-eb88-4fed-979e-9a05d1a77108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5f6fc27c3049a29ad00fa67a4a048f', 'request_id': 'req-0dc4aec7-eb88-4fed-979e-9a05d1a77108'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:39.446961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0dc4aec7-eb88-4fed-979e-9a05d1a77108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5f6fc27c3049a29ad00fa67a4a048f', 'request_id': 'req-0dc4aec7-eb88-4fed-979e-9a05d1a77108'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:39.459443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0dc4aec7-eb88-4fed-979e-9a05d1a77108 admin admin] The token cache is being invalidate because project 8e5f6fc27c3049a29ad00fa67a4a048f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:39.460026 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0dc4aec7-eb88-4fed-979e-9a05d1a77108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:39.461305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0dc4aec7-eb88-4fed-979e-9a05d1a77108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:39.462995 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1243/2478] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:39 2022] DELETE /identity/v3/projects/8e5f6fc27c3049a29ad00fa67a4a048f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:39.467837 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06929-dd51-4e37-bab0-6a240cda54c3 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:39.468123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06929-dd51-4e37-bab0-6a240cda54c3 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:39.468399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06929-dd51-4e37-bab0-6a240cda54c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:39.495962 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-85d06929-dd51-4e37-bab0-6a240cda54c3 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:39.497518 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-85d06929-dd51-4e37-bab0-6a240cda54c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:39.577227 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1236/2479] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:39.577382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12712db-5174-4f39-acb5-067fca2074f5 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:39.577382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12712db-5174-4f39-acb5-067fca2074f5 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:39.577382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12712db-5174-4f39-acb5-067fca2074f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:39.598492 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-f12712db-5174-4f39-acb5-067fca2074f5 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:39.599933 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f12712db-5174-4f39-acb5-067fca2074f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:39.613952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1244/2480] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:39.615107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06929-dd51-4e37-bab0-6a240cda54c3 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:39.627442 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06929-dd51-4e37-bab0-6a240cda54c3 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:39.632146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8d8ec-087a-4f0e-9b46-e1c267552389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:39.632821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8d8ec-087a-4f0e-9b46-e1c267552389 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:39.633108 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8d8ec-087a-4f0e-9b46-e1c267552389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:39.633385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8d8ec-087a-4f0e-9b46-e1c267552389 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:39.634117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8d8ec-087a-4f0e-9b46-e1c267552389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:42:39.634464 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8d8ec-087a-4f0e-9b46-e1c267552389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:39.636279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8d8ec-087a-4f0e-9b46-e1c267552389 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:39.652305 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1237/2481] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:42:39.656691 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12712db-5174-4f39-acb5-067fca2074f5 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:39.669253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12712db-5174-4f39-acb5-067fca2074f5 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:39.678972 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aabd78-c7d1-4f61-9d5d-67954e03cf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:39.680017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aabd78-c7d1-4f61-9d5d-67954e03cf33 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:39.680427 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aabd78-c7d1-4f61-9d5d-67954e03cf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:39.681352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aabd78-c7d1-4f61-9d5d-67954e03cf33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:39.686887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aabd78-c7d1-4f61-9d5d-67954e03cf33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:39.690619 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aabd78-c7d1-4f61-9d5d-67954e03cf33 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:39.725182 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1245/2482] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:39 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:42:39.731714 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8d8ec-087a-4f0e-9b46-e1c267552389 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:39.743196 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8d8ec-087a-4f0e-9b46-e1c267552389 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:39.808855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce681-a3ce-4597-8cc5-95539cb92aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:39.809451 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce681-a3ce-4597-8cc5-95539cb92aed admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:39.809734 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce681-a3ce-4597-8cc5-95539cb92aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:39.810019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce681-a3ce-4597-8cc5-95539cb92aed admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:39.810858 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fce681-a3ce-4597-8cc5-95539cb92aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:39.812799 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fce681-a3ce-4597-8cc5-95539cb92aed admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:39.838097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1238/2483] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:39 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:39.842298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aabd78-c7d1-4f61-9d5d-67954e03cf33 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:39.853307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aabd78-c7d1-4f61-9d5d-67954e03cf33 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:39.858184 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bdbfd-9504-45d1-85f7-e878062db540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:39.858974 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bdbfd-9504-45d1-85f7-e878062db540 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:39.859341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bdbfd-9504-45d1-85f7-e878062db540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:39.859705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bdbfd-9504-45d1-85f7-e878062db540 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:39.860540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bdbfd-9504-45d1-85f7-e878062db540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:39.862193 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bdbfd-9504-45d1-85f7-e878062db540 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:39.873364 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1246/2484] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:39.877383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce681-a3ce-4597-8cc5-95539cb92aed admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:39.889165 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce681-a3ce-4597-8cc5-95539cb92aed admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:39.895553 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e96a4-906e-483f-9186-6fd9bb477229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:39.896124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e96a4-906e-483f-9186-6fd9bb477229 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:39.896442 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e96a4-906e-483f-9186-6fd9bb477229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:39.896703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e96a4-906e-483f-9186-6fd9bb477229 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:39.897473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e96a4-906e-483f-9186-6fd9bb477229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:39.899347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e96a4-906e-483f-9186-6fd9bb477229 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:39.910308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1239/2485] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:39.914376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bdbfd-9504-45d1-85f7-e878062db540 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:39.924541 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bdbfd-9504-45d1-85f7-e878062db540 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:39.929398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568d13e-bbbb-481c-a6dc-ede29262670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:39.930418 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568d13e-bbbb-481c-a6dc-ede29262670d admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:39.930763 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568d13e-bbbb-481c-a6dc-ede29262670d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:39.931215 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568d13e-bbbb-481c-a6dc-ede29262670d admin admin] PATH_INFO: `/v3/projects/81c70e4d3954491cb61c4266a37ed152/users/f14b32c4cd0c4e9eb2de21f9486af219/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:39.946377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568d13e-bbbb-481c-a6dc-ede29262670d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c70e4d3954491cb61c4266a37ed152, user_id=f14b32c4cd0c4e9eb2de21f9486af219, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:39.949386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568d13e-bbbb-481c-a6dc-ede29262670d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:39.964635 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1247/2486] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:39 2022] PUT /identity/v3/projects/81c70e4d3954491cb61c4266a37ed152/users/f14b32c4cd0c4e9eb2de21f9486af219/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:39.975552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b95dc-202e-48f3-9870-040dcd28296a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:39.975846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b95dc-202e-48f3-9870-040dcd28296a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:39.976124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b95dc-202e-48f3-9870-040dcd28296a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:40.003778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-756b95dc-202e-48f3-9870-040dcd28296a None None] MFA Rules not processed for user `f14b32c4cd0c4e9eb2de21f9486af219`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:40.005035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-756b95dc-202e-48f3-9870-040dcd28296a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:40.073068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1240/2487] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:40.077893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568d13e-bbbb-481c-a6dc-ede29262670d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:40.150186 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568d13e-bbbb-481c-a6dc-ede29262670d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:40.155124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1098a-454e-49f1-81b7-05920180d9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:40.155796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1098a-454e-49f1-81b7-05920180d9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:40.156084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1098a-454e-49f1-81b7-05920180d9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:40.156370 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1098a-454e-49f1-81b7-05920180d9a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:40.157095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1098a-454e-49f1-81b7-05920180d9a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:40.159068 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1098a-454e-49f1-81b7-05920180d9a7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:40.187205 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1248/2488] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:40 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:40.191864 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b95dc-202e-48f3-9870-040dcd28296a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:40.202463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b95dc-202e-48f3-9870-040dcd28296a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:40.260931 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fee7b-c369-47ff-a9b1-3364b956b5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:40.261602 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fee7b-c369-47ff-a9b1-3364b956b5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:40.261886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fee7b-c369-47ff-a9b1-3364b956b5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:40.262160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fee7b-c369-47ff-a9b1-3364b956b5c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:40.262889 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fee7b-c369-47ff-a9b1-3364b956b5c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:40.264804 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fee7b-c369-47ff-a9b1-3364b956b5c2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:40.284972 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1241/2489] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:40 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:40.288833 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1098a-454e-49f1-81b7-05920180d9a7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:40.299996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1098a-454e-49f1-81b7-05920180d9a7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:40.305020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96030dc5-12d1-485b-ab54-a76425b5cc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:40.305681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96030dc5-12d1-485b-ab54-a76425b5cc77 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:40.305994 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96030dc5-12d1-485b-ab54-a76425b5cc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:40.306321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96030dc5-12d1-485b-ab54-a76425b5cc77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:40.307016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96030dc5-12d1-485b-ab54-a76425b5cc77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:40.308627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96030dc5-12d1-485b-ab54-a76425b5cc77 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:40.320996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1249/2490] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:40.326021 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fee7b-c369-47ff-a9b1-3364b956b5c2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:40.336869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fee7b-c369-47ff-a9b1-3364b956b5c2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:40.342158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c073f0f-99fd-4501-a1bb-cf3481df8997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:40.343088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c073f0f-99fd-4501-a1bb-cf3481df8997 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:40.343371 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c073f0f-99fd-4501-a1bb-cf3481df8997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:40.343641 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c073f0f-99fd-4501-a1bb-cf3481df8997 admin admin] PATH_INFO: `/v3/projects/9cc4399bb81e42a592231c2887c5e9de/users/ddb0aa695ad540f19857b043fbfa209b/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:40.359601 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c073f0f-99fd-4501-a1bb-cf3481df8997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc4399bb81e42a592231c2887c5e9de, user_id=ddb0aa695ad540f19857b043fbfa209b, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:40.362320 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c073f0f-99fd-4501-a1bb-cf3481df8997 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:40.377180 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1242/2491] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:40 2022] PUT /identity/v3/projects/9cc4399bb81e42a592231c2887c5e9de/users/ddb0aa695ad540f19857b043fbfa209b/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:40.381041 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96030dc5-12d1-485b-ab54-a76425b5cc77 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:40.390849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96030dc5-12d1-485b-ab54-a76425b5cc77 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:40.447647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d3840-61aa-48fa-ab39-3874e45377ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:40.448597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d3840-61aa-48fa-ab39-3874e45377ea admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:40.449167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d3840-61aa-48fa-ab39-3874e45377ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:40.449659 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d3840-61aa-48fa-ab39-3874e45377ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:40.451074 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d3840-61aa-48fa-ab39-3874e45377ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:40.452683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d3840-61aa-48fa-ab39-3874e45377ea admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:40.465710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1250/2492] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:40.469805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c073f0f-99fd-4501-a1bb-cf3481df8997 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:40.479944 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c073f0f-99fd-4501-a1bb-cf3481df8997 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:40.484556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f906a84-116c-40d0-96c2-f7271c882e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:40.486009 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f906a84-116c-40d0-96c2-f7271c882e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:40.486323 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f906a84-116c-40d0-96c2-f7271c882e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:40.486597 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f906a84-116c-40d0-96c2-f7271c882e28 admin admin] PATH_INFO: `/v3/projects/9cc4399bb81e42a592231c2887c5e9de/users/ddb0aa695ad540f19857b043fbfa209b/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:40.488548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f906a84-116c-40d0-96c2-f7271c882e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc4399bb81e42a592231c2887c5e9de, user_id=ddb0aa695ad540f19857b043fbfa209b, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:40.491489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f906a84-116c-40d0-96c2-f7271c882e28 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:40.502304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1243/2493] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:40 2022] PUT /identity/v3/projects/9cc4399bb81e42a592231c2887c5e9de/users/ddb0aa695ad540f19857b043fbfa209b/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:40.513349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6fc45-5b26-497b-a4f1-85d9110f59ce None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:40.513636 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6fc45-5b26-497b-a4f1-85d9110f59ce None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:40.513913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6fc45-5b26-497b-a4f1-85d9110f59ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:40.539211 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-91d6fc45-5b26-497b-a4f1-85d9110f59ce None None] MFA Rules not processed for user `ddb0aa695ad540f19857b043fbfa209b`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:40.540383 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-91d6fc45-5b26-497b-a4f1-85d9110f59ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:40.607965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1251/2494] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:40.621353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f906a84-116c-40d0-96c2-f7271c882e28 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:40.623155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6f906a84-116c-40d0-96c2-f7271c882e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:40.689456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f906a84-116c-40d0-96c2-f7271c882e28 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:40.693112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15038de7-e671-4634-bf3c-adf2a3a31cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:40.694042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15038de7-e671-4634-bf3c-adf2a3a31cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:40.694390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15038de7-e671-4634-bf3c-adf2a3a31cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:40.694667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15038de7-e671-4634-bf3c-adf2a3a31cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:40.703972 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15038de7-e671-4634-bf3c-adf2a3a31cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:40.705475 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15038de7-e671-4634-bf3c-adf2a3a31cf8 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:40.714964 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1244/2495] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:40.792964 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6fc45-5b26-497b-a4f1-85d9110f59ce None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:40.805978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6fc45-5b26-497b-a4f1-85d9110f59ce None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:40.821966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25c2d3-5483-4084-81a8-3feca1a70c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:40.822683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25c2d3-5483-4084-81a8-3feca1a70c96 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:40.822965 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25c2d3-5483-4084-81a8-3feca1a70c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:40.823295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25c2d3-5483-4084-81a8-3feca1a70c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:40.885124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25c2d3-5483-4084-81a8-3feca1a70c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:40.886636 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25c2d3-5483-4084-81a8-3feca1a70c96 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:40.896202 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1252/2496] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:41.171463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15038de7-e671-4634-bf3c-adf2a3a31cf8 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:41.237115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15038de7-e671-4634-bf3c-adf2a3a31cf8 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:41.242579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:41.243690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:41.244131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:41.244564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] PATH_INFO: `/v3/users/f14b32c4cd0c4e9eb2de21f9486af219` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:41.246077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14b32c4cd0c4e9eb2de21f9486af219)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:41.248252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:41.299441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14b32c4cd0c4e9eb2de21f9486af219'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:41.307014 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14b32c4cd0c4e9eb2de21f9486af219'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:41.319648 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14b32c4cd0c4e9eb2de21f9486af219'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:41.320984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14b32c4cd0c4e9eb2de21f9486af219'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:41.322198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14b32c4cd0c4e9eb2de21f9486af219'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:41.354904 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1245/2497] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:41 2022] DELETE /identity/v3/users/f14b32c4cd0c4e9eb2de21f9486af219 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:41.359364 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2e3e2-c863-4201-8560-54ece167d863 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:41.359838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2e3e2-c863-4201-8560-54ece167d863 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:41.359917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2e3e2-c863-4201-8560-54ece167d863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:41.377282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-08f2e3e2-c863-4201-8560-54ece167d863 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:41.378504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-08f2e3e2-c863-4201-8560-54ece167d863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:41.440584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1253/2498] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:41.448679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:41.450386 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:41.513559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250ab9d-1730-4ec0-aafb-b9e3c2c03a28 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:41.519026 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008ce4b-fa56-412e-b13c-8357b11590b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:41.519685 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008ce4b-fa56-412e-b13c-8357b11590b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:41.519965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008ce4b-fa56-412e-b13c-8357b11590b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:41.520237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008ce4b-fa56-412e-b13c-8357b11590b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:41.531360 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008ce4b-fa56-412e-b13c-8357b11590b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:41.534058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008ce4b-fa56-412e-b13c-8357b11590b6 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:41.545662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1246/2499] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:42:41.883447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2e3e2-c863-4201-8560-54ece167d863 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:41.885057 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-08f2e3e2-c863-4201-8560-54ece167d863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:41.899176 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2e3e2-c863-4201-8560-54ece167d863 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:41.905406 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:41.907055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:41.907549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:41.908264 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] PATH_INFO: `/v3/projects/81c70e4d3954491cb61c4266a37ed152` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:41.910544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c70e4d3954491cb61c4266a37ed152)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:41.912677 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:41.964169 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c70e4d3954491cb61c4266a37ed152', 'request_id': 'req-341efc45-8a16-4538-b59c-7541d077d088'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:41.969805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c70e4d3954491cb61c4266a37ed152', 'request_id': 'req-341efc45-8a16-4538-b59c-7541d077d088'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:41.978736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c70e4d3954491cb61c4266a37ed152', 'request_id': 'req-341efc45-8a16-4538-b59c-7541d077d088'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:41.991596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] The token cache is being invalidate because project 81c70e4d3954491cb61c4266a37ed152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:41.992101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:41.993087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:41.995119 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1254/2500] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:41 2022] DELETE /identity/v3/projects/81c70e4d3954491cb61c4266a37ed152 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:41.999287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008ce4b-fa56-412e-b13c-8357b11590b6 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:42.014369 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008ce4b-fa56-412e-b13c-8357b11590b6 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:42.073107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1836b6-c3d2-4d51-8998-91df4f96024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:42.073979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1836b6-c3d2-4d51-8998-91df4f96024d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:42.074286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1836b6-c3d2-4d51-8998-91df4f96024d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:42.074663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1836b6-c3d2-4d51-8998-91df4f96024d admin admin] PATH_INFO: `/v3/users/ddb0aa695ad540f19857b043fbfa209b` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:42.087403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1836b6-c3d2-4d51-8998-91df4f96024d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb0aa695ad540f19857b043fbfa209b)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:42.098616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1836b6-c3d2-4d51-8998-91df4f96024d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:42.152308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ca1836b6-c3d2-4d51-8998-91df4f96024d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb0aa695ad540f19857b043fbfa209b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.161088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ca1836b6-c3d2-4d51-8998-91df4f96024d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb0aa695ad540f19857b043fbfa209b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.176651 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ca1836b6-c3d2-4d51-8998-91df4f96024d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb0aa695ad540f19857b043fbfa209b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.178485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ca1836b6-c3d2-4d51-8998-91df4f96024d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb0aa695ad540f19857b043fbfa209b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.179366 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ca1836b6-c3d2-4d51-8998-91df4f96024d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb0aa695ad540f19857b043fbfa209b'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.197208 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1247/2501] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:41 2022] DELETE /identity/v3/users/ddb0aa695ad540f19857b043fbfa209b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:42.501796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:42.503338 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:42.522066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341efc45-8a16-4538-b59c-7541d077d088 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:42.592736 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51e313-bce4-44de-9e3d-a45219c3f3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:42.593605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e313-bce4-44de-9e3d-a45219c3f3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:42.593889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e313-bce4-44de-9e3d-a45219c3f3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:42.594191 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e313-bce4-44de-9e3d-a45219c3f3b8 admin admin] PATH_INFO: `/v3/projects/9cc4399bb81e42a592231c2887c5e9de` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:42.596151 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51e313-bce4-44de-9e3d-a45219c3f3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc4399bb81e42a592231c2887c5e9de)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:42.598080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51e313-bce4-44de-9e3d-a45219c3f3b8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:42.649951 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9a51e313-bce4-44de-9e3d-a45219c3f3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc4399bb81e42a592231c2887c5e9de', 'request_id': 'req-9a51e313-bce4-44de-9e3d-a45219c3f3b8'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.656557 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9a51e313-bce4-44de-9e3d-a45219c3f3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc4399bb81e42a592231c2887c5e9de', 'request_id': 'req-9a51e313-bce4-44de-9e3d-a45219c3f3b8'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.667357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9a51e313-bce4-44de-9e3d-a45219c3f3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc4399bb81e42a592231c2887c5e9de', 'request_id': 'req-9a51e313-bce4-44de-9e3d-a45219c3f3b8'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.684594 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9a51e313-bce4-44de-9e3d-a45219c3f3b8 admin admin] The token cache is being invalidate because project 9cc4399bb81e42a592231c2887c5e9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:42.684884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9a51e313-bce4-44de-9e3d-a45219c3f3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.685538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9a51e313-bce4-44de-9e3d-a45219c3f3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.690322 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1255/2502] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:42 2022] DELETE /identity/v3/projects/9cc4399bb81e42a592231c2887c5e9de => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:42.691971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586b1ba-b745-4d9e-998e-ac34b941f20a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:42.692255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586b1ba-b745-4d9e-998e-ac34b941f20a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:42.692552 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586b1ba-b745-4d9e-998e-ac34b941f20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:42.711772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-c586b1ba-b745-4d9e-998e-ac34b941f20a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:42.712909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c586b1ba-b745-4d9e-998e-ac34b941f20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:42.778393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1248/2503] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:42:42.784139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494448d-f365-49a4-a864-cc7f46da4586 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:42.784430 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494448d-f365-49a4-a864-cc7f46da4586 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:42.784883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494448d-f365-49a4-a864-cc7f46da4586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:42.804496 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-7494448d-f365-49a4-a864-cc7f46da4586 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:42.805884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7494448d-f365-49a4-a864-cc7f46da4586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:42.814692 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1256/2504] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:42.818737 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586b1ba-b745-4d9e-998e-ac34b941f20a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:42.828497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586b1ba-b745-4d9e-998e-ac34b941f20a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:42.833623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d09ad1-144f-4bf6-8484-13fb56c3a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:42.834280 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d09ad1-144f-4bf6-8484-13fb56c3a841 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:42.834564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d09ad1-144f-4bf6-8484-13fb56c3a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:42.834837 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d09ad1-144f-4bf6-8484-13fb56c3a841 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:42.835564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d09ad1-144f-4bf6-8484-13fb56c3a841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:42:42.835870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d09ad1-144f-4bf6-8484-13fb56c3a841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:42.837475 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d09ad1-144f-4bf6-8484-13fb56c3a841 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:42.850872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1249/2505] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:42:42.855502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494448d-f365-49a4-a864-cc7f46da4586 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:42.864793 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494448d-f365-49a4-a864-cc7f46da4586 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:42.870239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da328dbc-1764-4410-93b1-5ef039c92eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:42.870968 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da328dbc-1764-4410-93b1-5ef039c92eff admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:42.871339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da328dbc-1764-4410-93b1-5ef039c92eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:42.871690 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da328dbc-1764-4410-93b1-5ef039c92eff admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:42.872440 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da328dbc-1764-4410-93b1-5ef039c92eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:42.874447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da328dbc-1764-4410-93b1-5ef039c92eff admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:42.902820 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1257/2506] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:42 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:42.903949 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d09ad1-144f-4bf6-8484-13fb56c3a841 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:42.914011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d09ad1-144f-4bf6-8484-13fb56c3a841 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:42.967739 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8131b-4df1-45de-8ffd-a910fdb3fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:42.968402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8131b-4df1-45de-8ffd-a910fdb3fb8e admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:42.968681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8131b-4df1-45de-8ffd-a910fdb3fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:42.968951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8131b-4df1-45de-8ffd-a910fdb3fb8e admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:42.970266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8131b-4df1-45de-8ffd-a910fdb3fb8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:42.972195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8131b-4df1-45de-8ffd-a910fdb3fb8e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:42.995569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1250/2507] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:42 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:42.996740 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da328dbc-1764-4410-93b1-5ef039c92eff admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:43.007476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da328dbc-1764-4410-93b1-5ef039c92eff admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:43.012271 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bb6a5-14b7-4d1c-9843-4a5a15c82697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:43.013021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bb6a5-14b7-4d1c-9843-4a5a15c82697 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.013370 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bb6a5-14b7-4d1c-9843-4a5a15c82697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.013711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bb6a5-14b7-4d1c-9843-4a5a15c82697 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.014570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bb6a5-14b7-4d1c-9843-4a5a15c82697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:43.016766 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bb6a5-14b7-4d1c-9843-4a5a15c82697 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:43.027537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1258/2508] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:43.031569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8131b-4df1-45de-8ffd-a910fdb3fb8e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:43.042099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8131b-4df1-45de-8ffd-a910fdb3fb8e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:43.047272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872227b-bc5b-49ca-b382-9ee1db6bada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:43.048089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872227b-bc5b-49ca-b382-9ee1db6bada1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.048374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872227b-bc5b-49ca-b382-9ee1db6bada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.048651 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872227b-bc5b-49ca-b382-9ee1db6bada1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.049489 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872227b-bc5b-49ca-b382-9ee1db6bada1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:43.051218 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872227b-bc5b-49ca-b382-9ee1db6bada1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:43.061565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1251/2509] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:43.066547 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bb6a5-14b7-4d1c-9843-4a5a15c82697 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:43.077064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bb6a5-14b7-4d1c-9843-4a5a15c82697 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:43.082224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824aa19a-d3b0-47d7-829a-2205110455d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:43.083121 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824aa19a-d3b0-47d7-829a-2205110455d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.083403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824aa19a-d3b0-47d7-829a-2205110455d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.083671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824aa19a-d3b0-47d7-829a-2205110455d8 admin admin] PATH_INFO: `/v3/projects/bfefd0d8223c4a8abdce8b73552bc598/users/db69e982583843aaa83c1712438d15c1/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.084478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc90ed-d921-4421-b72e-a8e1d43c6b18 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.084769 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc90ed-d921-4421-b72e-a8e1d43c6b18 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.085243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc90ed-d921-4421-b72e-a8e1d43c6b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.099049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824aa19a-d3b0-47d7-829a-2205110455d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfefd0d8223c4a8abdce8b73552bc598, user_id=db69e982583843aaa83c1712438d15c1, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:43.101242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824aa19a-d3b0-47d7-829a-2205110455d8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:43.107461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-a9fc90ed-d921-4421-b72e-a8e1d43c6b18 None None] MFA Rules not processed for user `faac09d2bacd4759ada261c83b83362e`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:43.108604 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a9fc90ed-d921-4421-b72e-a8e1d43c6b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:43.114924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1259/2510] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:43 2022] PUT /identity/v3/projects/bfefd0d8223c4a8abdce8b73552bc598/users/db69e982583843aaa83c1712438d15c1/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:43.120067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c503d-4779-4d47-9577-98f22fb8c39a None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.120358 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c503d-4779-4d47-9577-98f22fb8c39a None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.120663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c503d-4779-4d47-9577-98f22fb8c39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.139426 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-bc2c503d-4779-4d47-9577-98f22fb8c39a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:43.140608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-bc2c503d-4779-4d47-9577-98f22fb8c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:43.168867 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1252/2511] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:42:43.200856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1260/2512] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:42:43.211421 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc90ed-d921-4421-b72e-a8e1d43c6b18 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:43.213220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a9fc90ed-d921-4421-b72e-a8e1d43c6b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:43.280993 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc90ed-d921-4421-b72e-a8e1d43c6b18 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:43.285647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32ef1f-5ea8-4880-a1b4-99205b3aa3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:43.286646 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ef1f-5ea8-4880-a1b4-99205b3aa3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.287122 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ef1f-5ea8-4880-a1b4-99205b3aa3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.287475 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ef1f-5ea8-4880-a1b4-99205b3aa3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.297105 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32ef1f-5ea8-4880-a1b4-99205b3aa3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:43.299191 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32ef1f-5ea8-4880-a1b4-99205b3aa3d3 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:43.309811 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1253/2513] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:44.228067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329c8d4-4597-4177-b61f-c22b2b9eb1d3 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.228067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329c8d4-4597-4177-b61f-c22b2b9eb1d3 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.228607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329c8d4-4597-4177-b61f-c22b2b9eb1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.263878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-0329c8d4-4597-4177-b61f-c22b2b9eb1d3 None None] MFA Rules not processed for user `db69e982583843aaa83c1712438d15c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:44.265151 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0329c8d4-4597-4177-b61f-c22b2b9eb1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:44.336855 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1261/2514] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:44.342444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32ef1f-5ea8-4880-a1b4-99205b3aa3d3 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:44.352166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32ef1f-5ea8-4880-a1b4-99205b3aa3d3 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:44.357435 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e45c32-07fa-42c9-965d-732dd716fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:44.358125 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e45c32-07fa-42c9-965d-732dd716fa5a admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.358384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e45c32-07fa-42c9-965d-732dd716fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.358660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e45c32-07fa-42c9-965d-732dd716fa5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.359358 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e45c32-07fa-42c9-965d-732dd716fa5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:44.361824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e45c32-07fa-42c9-965d-732dd716fa5a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:44.392384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1254/2515] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:44 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:42:44.393617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329c8d4-4597-4177-b61f-c22b2b9eb1d3 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:44.405456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329c8d4-4597-4177-b61f-c22b2b9eb1d3 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:44.474570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e625c54-4644-48c4-b301-b8236a07213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:44.475359 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625c54-4644-48c4-b301-b8236a07213f admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.475645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625c54-4644-48c4-b301-b8236a07213f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.475914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625c54-4644-48c4-b301-b8236a07213f admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.476603 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e625c54-4644-48c4-b301-b8236a07213f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:44.478849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e625c54-4644-48c4-b301-b8236a07213f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:44.501522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1262/2516] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:44 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:44.505560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e45c32-07fa-42c9-965d-732dd716fa5a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:44.516206 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e45c32-07fa-42c9-965d-732dd716fa5a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:44.520902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ac0b-5fbb-465e-91d7-c1330a4a07fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:44.521724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ac0b-5fbb-465e-91d7-c1330a4a07fc admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.522006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ac0b-5fbb-465e-91d7-c1330a4a07fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.522310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ac0b-5fbb-465e-91d7-c1330a4a07fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.523072 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06ac0b-5fbb-465e-91d7-c1330a4a07fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:44.524733 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06ac0b-5fbb-465e-91d7-c1330a4a07fc admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:44.538241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1255/2517] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:44.540108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e625c54-4644-48c4-b301-b8236a07213f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:44.550341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e625c54-4644-48c4-b301-b8236a07213f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:44.554914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa49d4-3524-459b-a086-610e1c61bb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:44.555792 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa49d4-3524-459b-a086-610e1c61bb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.556075 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa49d4-3524-459b-a086-610e1c61bb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.556347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa49d4-3524-459b-a086-610e1c61bb1d admin admin] PATH_INFO: `/v3/projects/6633d2584db84808a30be53712db698c/users/181411cb22754232ac8b8201f5a33312/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.571381 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa49d4-3524-459b-a086-610e1c61bb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6633d2584db84808a30be53712db698c, user_id=181411cb22754232ac8b8201f5a33312, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:44.574018 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa49d4-3524-459b-a086-610e1c61bb1d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:44.587446 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1263/2518] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:44 2022] PUT /identity/v3/projects/6633d2584db84808a30be53712db698c/users/181411cb22754232ac8b8201f5a33312/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:44.591349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ac0b-5fbb-465e-91d7-c1330a4a07fc admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:44.601511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ac0b-5fbb-465e-91d7-c1330a4a07fc admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:44.657394 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bcacd-d758-4fc4-b7e6-e1fa4cdfe0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:44.658254 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bcacd-d758-4fc4-b7e6-e1fa4cdfe0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.658538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bcacd-d758-4fc4-b7e6-e1fa4cdfe0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.658811 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bcacd-d758-4fc4-b7e6-e1fa4cdfe0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.659694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bcacd-d758-4fc4-b7e6-e1fa4cdfe0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:44.661295 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bcacd-d758-4fc4-b7e6-e1fa4cdfe0a8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:44.671280 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1256/2519] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:44.676057 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa49d4-3524-459b-a086-610e1c61bb1d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:44.686742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa49d4-3524-459b-a086-610e1c61bb1d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:44.691772 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f25027-3cc6-4359-9749-342e8730098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:44.692653 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f25027-3cc6-4359-9749-342e8730098c admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.692936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f25027-3cc6-4359-9749-342e8730098c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.693210 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f25027-3cc6-4359-9749-342e8730098c admin admin] PATH_INFO: `/v3/projects/6633d2584db84808a30be53712db698c/users/181411cb22754232ac8b8201f5a33312/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.695250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f25027-3cc6-4359-9749-342e8730098c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6633d2584db84808a30be53712db698c, user_id=181411cb22754232ac8b8201f5a33312, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:44.697891 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f25027-3cc6-4359-9749-342e8730098c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:44.707981 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1264/2520] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:44 2022] PUT /identity/v3/projects/6633d2584db84808a30be53712db698c/users/181411cb22754232ac8b8201f5a33312/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:45.618065 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb387311-4746-492d-bcff-0ebe01dafca1 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:45.618591 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb387311-4746-492d-bcff-0ebe01dafca1 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:45.618676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb387311-4746-492d-bcff-0ebe01dafca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:45.645407 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-eb387311-4746-492d-bcff-0ebe01dafca1 None None] MFA Rules not processed for user `181411cb22754232ac8b8201f5a33312`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:45.646660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-eb387311-4746-492d-bcff-0ebe01dafca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:45.727022 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1257/2521] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:45.738239 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f25027-3cc6-4359-9749-342e8730098c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:45.740003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-d1f25027-3cc6-4359-9749-342e8730098c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:45.803056 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f25027-3cc6-4359-9749-342e8730098c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:45.808655 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40ca34-f7c3-43e7-8866-ce28a9efcd6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:45.809335 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40ca34-f7c3-43e7-8866-ce28a9efcd6f service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:45.809622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40ca34-f7c3-43e7-8866-ce28a9efcd6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:45.809906 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40ca34-f7c3-43e7-8866-ce28a9efcd6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:45.892789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40ca34-f7c3-43e7-8866-ce28a9efcd6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:45.895132 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40ca34-f7c3-43e7-8866-ce28a9efcd6f service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:45.938198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1265/2522] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:47.509202 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb387311-4746-492d-bcff-0ebe01dafca1 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:47.510725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-eb387311-4746-492d-bcff-0ebe01dafca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:47.523545 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb387311-4746-492d-bcff-0ebe01dafca1 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:47.527347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08ac4b-e0f5-4c4b-aabc-9a57b0d7c116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:47.528070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08ac4b-e0f5-4c4b-aabc-9a57b0d7c116 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:47.528423 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08ac4b-e0f5-4c4b-aabc-9a57b0d7c116 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:47.528770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08ac4b-e0f5-4c4b-aabc-9a57b0d7c116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:47.540359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08ac4b-e0f5-4c4b-aabc-9a57b0d7c116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:47.541807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08ac4b-e0f5-4c4b-aabc-9a57b0d7c116 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:47.552027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1258/2523] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:47 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:53.994575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc18904-094e-454c-9a26-34e9551c5faf None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:53.995075 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc18904-094e-454c-9a26-34e9551c5faf None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:53.995245 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc18904-094e-454c-9a26-34e9551c5faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:54.012124 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-5bc18904-094e-454c-9a26-34e9551c5faf None None] MFA Rules not processed for user `0c131301aa22491f8b1feb32d006ea62`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:54.013568 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5bc18904-094e-454c-9a26-34e9551c5faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:54.069983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1266/2524] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:42:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:54.441926 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7bbbc-8bf9-45ae-8ac0-774f87164e72 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:54.442457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7bbbc-8bf9-45ae-8ac0-774f87164e72 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:54.442597 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7bbbc-8bf9-45ae-8ac0-774f87164e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:54.463861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-c4f7bbbc-8bf9-45ae-8ac0-774f87164e72 None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:54.465048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c4f7bbbc-8bf9-45ae-8ac0-774f87164e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:54.528985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1259/2525] 10.222.0.79 () {58 vars in 967 bytes} [Mon Feb 21 01:42:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:54.574354 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc18904-094e-454c-9a26-34e9551c5faf None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:54.575784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5bc18904-094e-454c-9a26-34e9551c5faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:54.658916 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc18904-094e-454c-9a26-34e9551c5faf None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:54.664158 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcb2f7-d85b-4124-a89b-c6d572544358 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:54.664818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcb2f7-d85b-4124-a89b-c6d572544358 service swift] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:54.665101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcb2f7-d85b-4124-a89b-c6d572544358 service swift] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:54.665382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcb2f7-d85b-4124-a89b-c6d572544358 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:54.674760 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcb2f7-d85b-4124-a89b-c6d572544358 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:54.676386 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcb2f7-d85b-4124-a89b-c6d572544358 service swift] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:54.685912 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1267/2526] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:42:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:43:00.609745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7bbbc-8bf9-45ae-8ac0-774f87164e72 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:00.611344 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c4f7bbbc-8bf9-45ae-8ac0-774f87164e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:00.685286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7bbbc-8bf9-45ae-8ac0-774f87164e72 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:00.690816 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af2b11-01eb-4694-ace4-671d63115851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:00.691543 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af2b11-01eb-4694-ace4-671d63115851 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:00.691826 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af2b11-01eb-4694-ace4-671d63115851 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:00.692166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af2b11-01eb-4694-ace4-671d63115851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:00.694155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-32af2b11-01eb-4694-ace4-671d63115851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:00.772580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af2b11-01eb-4694-ace4-671d63115851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:00.774027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af2b11-01eb-4694-ace4-671d63115851 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:00.786534 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1260/2527] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:01.344317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcb2f7-d85b-4124-a89b-c6d572544358 service swift] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:01.433608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcb2f7-d85b-4124-a89b-c6d572544358 service swift] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:01.441541 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:01.447059 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:01.448174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:01.448174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] PATH_INFO: `/v3/users/db69e982583843aaa83c1712438d15c1` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:01.449310 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db69e982583843aaa83c1712438d15c1)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:01.451542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:01.511830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db69e982583843aaa83c1712438d15c1'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:01.520384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db69e982583843aaa83c1712438d15c1'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:01.534051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db69e982583843aaa83c1712438d15c1'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:01.534811 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db69e982583843aaa83c1712438d15c1'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:01.542065 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db69e982583843aaa83c1712438d15c1'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:01.548455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1268/2528] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:01 2022] DELETE /identity/v3/users/db69e982583843aaa83c1712438d15c1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:01.721070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af2b11-01eb-4694-ace4-671d63115851 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:01.737588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af2b11-01eb-4694-ace4-671d63115851 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:01.820190 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:01.821393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:01.821837 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:01.822316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] PATH_INFO: `/v3/projects/bfefd0d8223c4a8abdce8b73552bc598` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:01.823757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfefd0d8223c4a8abdce8b73552bc598)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:01.826054 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:01.898827 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfefd0d8223c4a8abdce8b73552bc598', 'request_id': 'req-0227ad3b-d6f8-49e2-8b72-766b1f090472'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:01.924965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfefd0d8223c4a8abdce8b73552bc598', 'request_id': 'req-0227ad3b-d6f8-49e2-8b72-766b1f090472'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:01.943850 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfefd0d8223c4a8abdce8b73552bc598', 'request_id': 'req-0227ad3b-d6f8-49e2-8b72-766b1f090472'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:01.959490 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] The token cache is being invalidate because project bfefd0d8223c4a8abdce8b73552bc598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:01.960029 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:01.961217 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:01.964035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1261/2529] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:01 2022] DELETE /identity/v3/projects/bfefd0d8223c4a8abdce8b73552bc598 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:01.967911 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:01.970625 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:01.994844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70d1f4-3eec-4751-8f3c-93b2855dec47 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:02.073833 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:02.074782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:02.075053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:02.075324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] PATH_INFO: `/v3/users/181411cb22754232ac8b8201f5a33312` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:02.076592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181411cb22754232ac8b8201f5a33312)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:02.078771 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:02.128910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:02.132833 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:02.165476 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181411cb22754232ac8b8201f5a33312'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:02.182070 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181411cb22754232ac8b8201f5a33312'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:02.202584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181411cb22754232ac8b8201f5a33312'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:02.204035 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181411cb22754232ac8b8201f5a33312'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:02.214580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181411cb22754232ac8b8201f5a33312'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:02.216223 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227ad3b-d6f8-49e2-8b72-766b1f090472 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:02.224251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1269/2530] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:01 2022] DELETE /identity/v3/users/181411cb22754232ac8b8201f5a33312 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:02.226950 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06615f-349b-480a-9331-bdde900a9934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:02.227869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06615f-349b-480a-9331-bdde900a9934 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:02.228155 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06615f-349b-480a-9331-bdde900a9934 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:02.228430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06615f-349b-480a-9331-bdde900a9934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:02.230300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-aa06615f-349b-480a-9331-bdde900a9934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:02.331324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06615f-349b-480a-9331-bdde900a9934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:02.336934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06615f-349b-480a-9331-bdde900a9934 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:02.351500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1262/2531] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:02.462544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:02.464485 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:02.551378 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86dc8b-5a67-4ca3-a28f-eea8a1ba5ae6 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:02.557001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271713d-d62d-47a5-985e-e549e26d8d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:02.557868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271713d-d62d-47a5-985e-e549e26d8d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:02.558150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271713d-d62d-47a5-985e-e549e26d8d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:02.558471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271713d-d62d-47a5-985e-e549e26d8d06 admin admin] PATH_INFO: `/v3/projects/6633d2584db84808a30be53712db698c` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:02.559653 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271713d-d62d-47a5-985e-e549e26d8d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6633d2584db84808a30be53712db698c)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:02.561571 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271713d-d62d-47a5-985e-e549e26d8d06 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:02.627734 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-4271713d-d62d-47a5-985e-e549e26d8d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6633d2584db84808a30be53712db698c', 'request_id': 'req-4271713d-d62d-47a5-985e-e549e26d8d06'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:02.633745 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-4271713d-d62d-47a5-985e-e549e26d8d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6633d2584db84808a30be53712db698c', 'request_id': 'req-4271713d-d62d-47a5-985e-e549e26d8d06'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:02.643898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-4271713d-d62d-47a5-985e-e549e26d8d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6633d2584db84808a30be53712db698c', 'request_id': 'req-4271713d-d62d-47a5-985e-e549e26d8d06'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:02.655492 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-4271713d-d62d-47a5-985e-e549e26d8d06 admin admin] The token cache is being invalidate because project 6633d2584db84808a30be53712db698c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:02.655779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-4271713d-d62d-47a5-985e-e549e26d8d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:02.656963 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-4271713d-d62d-47a5-985e-e549e26d8d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:02.658529 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1270/2532] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:02 2022] DELETE /identity/v3/projects/6633d2584db84808a30be53712db698c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:02.663364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd612e-64eb-444c-b81f-d5035897f91c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:02.664619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd612e-64eb-444c-b81f-d5035897f91c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:02.664619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd612e-64eb-444c-b81f-d5035897f91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:02.682315 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-30bd612e-64eb-444c-b81f-d5035897f91c None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:02.683640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-30bd612e-64eb-444c-b81f-d5035897f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:02.739535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1263/2533] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:02.747472 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b43a7-76ea-4f4c-9f3b-a3e46390497a None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:02.747760 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b43a7-76ea-4f4c-9f3b-a3e46390497a None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:02.748037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b43a7-76ea-4f4c-9f3b-a3e46390497a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:02.766389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-300b43a7-76ea-4f4c-9f3b-a3e46390497a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:02.767647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-300b43a7-76ea-4f4c-9f3b-a3e46390497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:02.775823 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1271/2534] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:02.780009 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd612e-64eb-444c-b81f-d5035897f91c None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:02.790605 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd612e-64eb-444c-b81f-d5035897f91c None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:02.795328 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dd1f6-82b3-443b-83d4-679989cb16aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:02.796063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dd1f6-82b3-443b-83d4-679989cb16aa admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:02.796416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dd1f6-82b3-443b-83d4-679989cb16aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:02.797343 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dd1f6-82b3-443b-83d4-679989cb16aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:02.798158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dd1f6-82b3-443b-83d4-679989cb16aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:02.798642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dd1f6-82b3-443b-83d4-679989cb16aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:02.800251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dd1f6-82b3-443b-83d4-679989cb16aa admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:02.812087 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1264/2535] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:02.816324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b43a7-76ea-4f4c-9f3b-a3e46390497a None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:02.825365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b43a7-76ea-4f4c-9f3b-a3e46390497a None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:02.830342 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62b54d-798b-42c5-a44f-ffabdfb58da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:02.830983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62b54d-798b-42c5-a44f-ffabdfb58da8 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:02.831264 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62b54d-798b-42c5-a44f-ffabdfb58da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:02.831530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62b54d-798b-42c5-a44f-ffabdfb58da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:02.832219 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62b54d-798b-42c5-a44f-ffabdfb58da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:02.834098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62b54d-798b-42c5-a44f-ffabdfb58da8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:02.860316 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1272/2536] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:02 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:02.864414 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dd1f6-82b3-443b-83d4-679989cb16aa admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:02.874449 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dd1f6-82b3-443b-83d4-679989cb16aa admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:02.928692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf37d9f-bec5-4e6b-aad3-f6959900a2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:02.929374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf37d9f-bec5-4e6b-aad3-f6959900a2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:02.929655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf37d9f-bec5-4e6b-aad3-f6959900a2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:02.929981 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf37d9f-bec5-4e6b-aad3-f6959900a2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:02.930742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf37d9f-bec5-4e6b-aad3-f6959900a2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:02.932644 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf37d9f-bec5-4e6b-aad3-f6959900a2f4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:02.955293 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1265/2537] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:02 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:02.959540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62b54d-798b-42c5-a44f-ffabdfb58da8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:02.970534 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62b54d-798b-42c5-a44f-ffabdfb58da8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:02.975401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a923b66-505b-48bb-a3d5-bdc3d7e07dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:02.976071 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a923b66-505b-48bb-a3d5-bdc3d7e07dff admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:02.976356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a923b66-505b-48bb-a3d5-bdc3d7e07dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:02.976629 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a923b66-505b-48bb-a3d5-bdc3d7e07dff admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:02.977708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a923b66-505b-48bb-a3d5-bdc3d7e07dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:02.979005 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a923b66-505b-48bb-a3d5-bdc3d7e07dff admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:02.991562 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1273/2538] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:02.995594 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf37d9f-bec5-4e6b-aad3-f6959900a2f4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:03.007045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf37d9f-bec5-4e6b-aad3-f6959900a2f4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:03.011807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59db44-9de3-46ed-b17b-6499d883bd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:03.012611 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59db44-9de3-46ed-b17b-6499d883bd67 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:03.012894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59db44-9de3-46ed-b17b-6499d883bd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:03.013167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59db44-9de3-46ed-b17b-6499d883bd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:03.013934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59db44-9de3-46ed-b17b-6499d883bd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:03.016242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59db44-9de3-46ed-b17b-6499d883bd67 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:03.030390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1266/2539] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:03.034464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a923b66-505b-48bb-a3d5-bdc3d7e07dff admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:03.050505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a923b66-505b-48bb-a3d5-bdc3d7e07dff admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:03.055383 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9685366-aa91-40dd-b489-f36ce591908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:03.056268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9685366-aa91-40dd-b489-f36ce591908b admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:03.056552 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9685366-aa91-40dd-b489-f36ce591908b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:03.056827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9685366-aa91-40dd-b489-f36ce591908b admin admin] PATH_INFO: `/v3/projects/2136d72bb49240c4800228cfe6aa66c9/users/d23572ca3c474bd2b22c1d5ea72604c3/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:03.072443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9685366-aa91-40dd-b489-f36ce591908b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2136d72bb49240c4800228cfe6aa66c9, user_id=d23572ca3c474bd2b22c1d5ea72604c3, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:03.075144 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9685366-aa91-40dd-b489-f36ce591908b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:03.089233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1274/2540] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:03 2022] PUT /identity/v3/projects/2136d72bb49240c4800228cfe6aa66c9/users/d23572ca3c474bd2b22c1d5ea72604c3/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:03.106312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb41f4-7555-4a67-82bb-4bf307a34d85 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:03.106312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb41f4-7555-4a67-82bb-4bf307a34d85 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:03.106312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb41f4-7555-4a67-82bb-4bf307a34d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:03.137432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-13cb41f4-7555-4a67-82bb-4bf307a34d85 None None] MFA Rules not processed for user `d23572ca3c474bd2b22c1d5ea72604c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:03.138763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-13cb41f4-7555-4a67-82bb-4bf307a34d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:03.211347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9685366-aa91-40dd-b489-f36ce591908b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:03.216846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1267/2541] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:03.290292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9685366-aa91-40dd-b489-f36ce591908b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:03.298663 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253cfb0-b9df-4d2e-a015-05be55a7a5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:03.299332 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253cfb0-b9df-4d2e-a015-05be55a7a5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:03.299614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253cfb0-b9df-4d2e-a015-05be55a7a5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:03.299887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253cfb0-b9df-4d2e-a015-05be55a7a5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:03.300575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253cfb0-b9df-4d2e-a015-05be55a7a5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:03.303650 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253cfb0-b9df-4d2e-a015-05be55a7a5b9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:03.347138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1275/2542] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:03 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:03.351243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb41f4-7555-4a67-82bb-4bf307a34d85 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:03.371389 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb41f4-7555-4a67-82bb-4bf307a34d85 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:03.476720 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0597a-3d14-445e-b38d-03fc9b56805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:03.478689 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0597a-3d14-445e-b38d-03fc9b56805f admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:03.479434 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0597a-3d14-445e-b38d-03fc9b56805f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:03.479719 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0597a-3d14-445e-b38d-03fc9b56805f admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:03.480434 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0597a-3d14-445e-b38d-03fc9b56805f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:03.485048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0597a-3d14-445e-b38d-03fc9b56805f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:03.542119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1268/2543] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:03 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:03.545914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253cfb0-b9df-4d2e-a015-05be55a7a5b9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:03.567873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253cfb0-b9df-4d2e-a015-05be55a7a5b9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:03.580708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9f586-6fa5-49b4-aaf6-e6f4eb0be354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:03.581501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9f586-6fa5-49b4-aaf6-e6f4eb0be354 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:03.581870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9f586-6fa5-49b4-aaf6-e6f4eb0be354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:03.582295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9f586-6fa5-49b4-aaf6-e6f4eb0be354 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:03.583647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9f586-6fa5-49b4-aaf6-e6f4eb0be354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:03.587130 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9f586-6fa5-49b4-aaf6-e6f4eb0be354 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:03.611184 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1276/2544] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:03.615614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0597a-3d14-445e-b38d-03fc9b56805f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:03.629746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0597a-3d14-445e-b38d-03fc9b56805f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:03.634937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc8bc7-23a8-4885-8208-61e0e3749044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:03.635619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc8bc7-23a8-4885-8208-61e0e3749044 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:03.635902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc8bc7-23a8-4885-8208-61e0e3749044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:03.636179 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc8bc7-23a8-4885-8208-61e0e3749044 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:03.636907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc8bc7-23a8-4885-8208-61e0e3749044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:03.638593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc8bc7-23a8-4885-8208-61e0e3749044 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:03.654726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1269/2545] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:03.656502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9f586-6fa5-49b4-aaf6-e6f4eb0be354 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:03.668643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9f586-6fa5-49b4-aaf6-e6f4eb0be354 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:03.683277 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b21236-41e2-4ea9-a6ca-b74497f8cb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:03.684336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b21236-41e2-4ea9-a6ca-b74497f8cb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:03.684709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b21236-41e2-4ea9-a6ca-b74497f8cb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:03.685208 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b21236-41e2-4ea9-a6ca-b74497f8cb36 admin admin] PATH_INFO: `/v3/projects/dc4f107e3b2e49beb0bebed7400f71b6/users/92fbad076a25445996b83c084d6360b2/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:03.704785 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b21236-41e2-4ea9-a6ca-b74497f8cb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4f107e3b2e49beb0bebed7400f71b6, user_id=92fbad076a25445996b83c084d6360b2, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:03.708246 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b21236-41e2-4ea9-a6ca-b74497f8cb36 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:03.736538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1277/2546] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:03 2022] PUT /identity/v3/projects/dc4f107e3b2e49beb0bebed7400f71b6/users/92fbad076a25445996b83c084d6360b2/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:03.750791 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53aed6c-f2a6-417b-8eb8-d65db947f3a0 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:03.751235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53aed6c-f2a6-417b-8eb8-d65db947f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:03.751352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53aed6c-f2a6-417b-8eb8-d65db947f3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:03.752867 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b21236-41e2-4ea9-a6ca-b74497f8cb36 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:03.755467 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-67b21236-41e2-4ea9-a6ca-b74497f8cb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:03.815356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-c53aed6c-f2a6-417b-8eb8-d65db947f3a0 None None] MFA Rules not processed for user `92fbad076a25445996b83c084d6360b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:03.816821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c53aed6c-f2a6-417b-8eb8-d65db947f3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:03.839543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b21236-41e2-4ea9-a6ca-b74497f8cb36 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:03.848992 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:03.849970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:03.850158 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:03.850469 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] PATH_INFO: `/v3/users/0d6b8346f8144ec4bebdadd1e5572317` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:03.851697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6b8346f8144ec4bebdadd1e5572317)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:03.853656 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:03.887281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1270/2547] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:03.892514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53aed6c-f2a6-417b-8eb8-d65db947f3a0 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:03.902820 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53aed6c-f2a6-417b-8eb8-d65db947f3a0 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:03.903500 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6b8346f8144ec4bebdadd1e5572317'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:03.908179 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a5959-7698-4c2d-b7c5-a39b647fc972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:03.908987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a5959-7698-4c2d-b7c5-a39b647fc972 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:03.909430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a5959-7698-4c2d-b7c5-a39b647fc972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:03.909763 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a5959-7698-4c2d-b7c5-a39b647fc972 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:03.910639 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a5959-7698-4c2d-b7c5-a39b647fc972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:03.912115 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6b8346f8144ec4bebdadd1e5572317'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:03.912783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a5959-7698-4c2d-b7c5-a39b647fc972 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:03.924644 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6b8346f8144ec4bebdadd1e5572317'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:03.925649 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6b8346f8144ec4bebdadd1e5572317'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:03.933384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6b8346f8144ec4bebdadd1e5572317'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:03.939442 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1278/2548] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:03 2022] DELETE /identity/v3/users/0d6b8346f8144ec4bebdadd1e5572317 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:03.944697 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1271/2549] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:03 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:03.949668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:03.951315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:04.021128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de5a2e-d760-4b95-95b2-a5899332e5ca admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:04.087105 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f2574-a4c2-4106-8119-6a59f1223efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:04.087790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f2574-a4c2-4106-8119-6a59f1223efb admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:04.090733 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f2574-a4c2-4106-8119-6a59f1223efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:04.090733 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f2574-a4c2-4106-8119-6a59f1223efb admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:04.090733 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f2574-a4c2-4106-8119-6a59f1223efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:04.091051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f2574-a4c2-4106-8119-6a59f1223efb admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:04.111677 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1279/2550] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:03 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:04.118068 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a5959-7698-4c2d-b7c5-a39b647fc972 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:04.129799 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a5959-7698-4c2d-b7c5-a39b647fc972 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:04.134891 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3867203-cfdb-4e06-973e-6589a0cc7151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:04.135373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f2574-a4c2-4106-8119-6a59f1223efb admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:04.135564 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867203-cfdb-4e06-973e-6589a0cc7151 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:04.135898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867203-cfdb-4e06-973e-6589a0cc7151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:04.136177 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867203-cfdb-4e06-973e-6589a0cc7151 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:04.136905 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3867203-cfdb-4e06-973e-6589a0cc7151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:04.137598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b80f2574-a4c2-4106-8119-6a59f1223efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:04.138615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3867203-cfdb-4e06-973e-6589a0cc7151 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:04.150081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1272/2551] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:04.153773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f2574-a4c2-4106-8119-6a59f1223efb admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:04.154672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3867203-cfdb-4e06-973e-6589a0cc7151 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:04.157470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:04.158344 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:04.158640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:04.159025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] PATH_INFO: `/v3/projects/8a01e8a980fc419f88335882f4f61612` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:04.160122 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a01e8a980fc419f88335882f4f61612)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:04.162013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:04.165565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3867203-cfdb-4e06-973e-6589a0cc7151 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:04.171162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe26427-00be-4d11-98a4-86c8d2f1a12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:04.172206 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe26427-00be-4d11-98a4-86c8d2f1a12f admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:04.172556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe26427-00be-4d11-98a4-86c8d2f1a12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:04.173005 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe26427-00be-4d11-98a4-86c8d2f1a12f admin admin] PATH_INFO: `/v3/projects/68b9c2c7025342a68cb8272358958c35/users/056b535183174d89ba64940ff3964902/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:04.188284 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe26427-00be-4d11-98a4-86c8d2f1a12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b9c2c7025342a68cb8272358958c35, user_id=056b535183174d89ba64940ff3964902, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:04.191024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe26427-00be-4d11-98a4-86c8d2f1a12f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:04.204919 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1273/2552] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:04 2022] PUT /identity/v3/projects/68b9c2c7025342a68cb8272358958c35/users/056b535183174d89ba64940ff3964902/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:04.208999 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe26427-00be-4d11-98a4-86c8d2f1a12f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:04.212025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a01e8a980fc419f88335882f4f61612', 'request_id': 'req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.217134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a01e8a980fc419f88335882f4f61612', 'request_id': 'req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.225519 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a01e8a980fc419f88335882f4f61612', 'request_id': 'req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.237402 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] The token cache is being invalidate because project 8a01e8a980fc419f88335882f4f61612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:04.237687 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.238359 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.239899 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1280/2553] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:04 2022] DELETE /identity/v3/projects/8a01e8a980fc419f88335882f4f61612 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:04.243888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:04.245213 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:04.270401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe26427-00be-4d11-98a4-86c8d2f1a12f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:04.307345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58b2e-4f68-49b0-b1b6-b7ca9a51edb8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:04.312010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:04.313373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:04.313652 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:04.313921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] PATH_INFO: `/v3/users/b9ab6655901a4d499d66f4c69f5fe466` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:04.315180 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ab6655901a4d499d66f4c69f5fe466)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:04.317076 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:04.324216 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c45a2-c0af-43ed-bb59-5fc2d188b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:04.324908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c45a2-c0af-43ed-bb59-5fc2d188b5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:04.325192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c45a2-c0af-43ed-bb59-5fc2d188b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:04.325467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c45a2-c0af-43ed-bb59-5fc2d188b5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:04.326194 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c45a2-c0af-43ed-bb59-5fc2d188b5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:04.328469 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c45a2-c0af-43ed-bb59-5fc2d188b5c5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:04.338237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1274/2554] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:04.342598 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c45a2-c0af-43ed-bb59-5fc2d188b5c5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:04.345099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-387c45a2-c0af-43ed-bb59-5fc2d188b5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:04.357219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c45a2-c0af-43ed-bb59-5fc2d188b5c5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:04.362405 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff056bb8-9937-4245-9d34-337494ed8eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:04.363277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff056bb8-9937-4245-9d34-337494ed8eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:04.363501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ab6655901a4d499d66f4c69f5fe466'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.363614 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff056bb8-9937-4245-9d34-337494ed8eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:04.363819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff056bb8-9937-4245-9d34-337494ed8eeb admin admin] PATH_INFO: `/v3/projects/68b9c2c7025342a68cb8272358958c35/users/056b535183174d89ba64940ff3964902/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:04.366285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff056bb8-9937-4245-9d34-337494ed8eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b9c2c7025342a68cb8272358958c35, user_id=056b535183174d89ba64940ff3964902, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:04.369305 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff056bb8-9937-4245-9d34-337494ed8eeb admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:04.370918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ab6655901a4d499d66f4c69f5fe466'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.379414 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1275/2555] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:04 2022] PUT /identity/v3/projects/68b9c2c7025342a68cb8272358958c35/users/056b535183174d89ba64940ff3964902/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:04.382782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ab6655901a4d499d66f4c69f5fe466'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.383485 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ab6655901a4d499d66f4c69f5fe466'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.389483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4a496-8380-44a8-8d7f-0a5a310d027e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:04.389771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4a496-8380-44a8-8d7f-0a5a310d027e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:04.390049 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4a496-8380-44a8-8d7f-0a5a310d027e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:04.390518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ab6655901a4d499d66f4c69f5fe466'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.396343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1281/2556] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:04 2022] DELETE /identity/v3/users/b9ab6655901a4d499d66f4c69f5fe466 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:04.416706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-77b4a496-8380-44a8-8d7f-0a5a310d027e None None] MFA Rules not processed for user `056b535183174d89ba64940ff3964902`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:04.417826 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-77b4a496-8380-44a8-8d7f-0a5a310d027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:04.484198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1276/2557] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:04.493813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:04.495270 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:04.550635 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb687025-5b99-4399-b669-9dcdc0794bde admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:04.554537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c88dd-5b33-4890-943e-b9d5f342978e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:04.555194 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c88dd-5b33-4890-943e-b9d5f342978e service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:04.555479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c88dd-5b33-4890-943e-b9d5f342978e service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:04.555865 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c88dd-5b33-4890-943e-b9d5f342978e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:04.557918 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3f1c88dd-5b33-4890-943e-b9d5f342978e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:04.569635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4a496-8380-44a8-8d7f-0a5a310d027e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:04.571308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-77b4a496-8380-44a8-8d7f-0a5a310d027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:04.623948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c88dd-5b33-4890-943e-b9d5f342978e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:04.625950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c88dd-5b33-4890-943e-b9d5f342978e service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:04.634769 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1282/2558] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:04.636352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4a496-8380-44a8-8d7f-0a5a310d027e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:04.641027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:04.641870 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:04.642154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:04.642456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] PATH_INFO: `/v3/projects/acc95a1db9b04149bf00fa406decd5e0` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:04.643700 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc95a1db9b04149bf00fa406decd5e0)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:04.645694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:04.693845 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc95a1db9b04149bf00fa406decd5e0', 'request_id': 'req-fea4d01a-0240-4f92-86e2-7488bea5d5e4'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.699755 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc95a1db9b04149bf00fa406decd5e0', 'request_id': 'req-fea4d01a-0240-4f92-86e2-7488bea5d5e4'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.707093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc95a1db9b04149bf00fa406decd5e0', 'request_id': 'req-fea4d01a-0240-4f92-86e2-7488bea5d5e4'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.716991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] The token cache is being invalidate because project acc95a1db9b04149bf00fa406decd5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:04.717277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.717908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:04.719492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1277/2559] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:04 2022] DELETE /identity/v3/projects/acc95a1db9b04149bf00fa406decd5e0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:06.026581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c88dd-5b33-4890-943e-b9d5f342978e service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:06.028117 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3f1c88dd-5b33-4890-943e-b9d5f342978e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:06.100094 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c88dd-5b33-4890-943e-b9d5f342978e service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:06.162915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9910c-094a-4875-b3ba-288c4dcf1e02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:06.163510 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9910c-094a-4875-b3ba-288c4dcf1e02 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:06.163790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9910c-094a-4875-b3ba-288c4dcf1e02 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:06.164060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9910c-094a-4875-b3ba-288c4dcf1e02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:06.165838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a6b9910c-094a-4875-b3ba-288c4dcf1e02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:06.196785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:06.198324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:06.227097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9910c-094a-4875-b3ba-288c4dcf1e02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:06.228678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9910c-094a-4875-b3ba-288c4dcf1e02 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:06.237795 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1283/2560] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:06.254070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4d01a-0240-4f92-86e2-7488bea5d5e4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:06.257647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5197e4-24a6-4d7b-8a8a-5621622bcce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:06.258338 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5197e4-24a6-4d7b-8a8a-5621622bcce7 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:06.258615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5197e4-24a6-4d7b-8a8a-5621622bcce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:06.258884 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5197e4-24a6-4d7b-8a8a-5621622bcce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:06.260725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-dc5197e4-24a6-4d7b-8a8a-5621622bcce7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:06.317853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5197e4-24a6-4d7b-8a8a-5621622bcce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:06.319329 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5197e4-24a6-4d7b-8a8a-5621622bcce7 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:06.328765 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1278/2561] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:06.832555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9910c-094a-4875-b3ba-288c4dcf1e02 service nova] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:06.841645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9910c-094a-4875-b3ba-288c4dcf1e02 service nova] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:06.845352 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cbeef-0c97-4bdb-81ef-f01b8cc934d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:06.845982 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cbeef-0c97-4bdb-81ef-f01b8cc934d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:06.846299 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cbeef-0c97-4bdb-81ef-f01b8cc934d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:06.846570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cbeef-0c97-4bdb-81ef-f01b8cc934d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:06.848432 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-625cbeef-0c97-4bdb-81ef-f01b8cc934d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:06.910658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cbeef-0c97-4bdb-81ef-f01b8cc934d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:06.912101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cbeef-0c97-4bdb-81ef-f01b8cc934d1 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:06.921869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1284/2562] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:10.769923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5197e4-24a6-4d7b-8a8a-5621622bcce7 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:10.771387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-dc5197e4-24a6-4d7b-8a8a-5621622bcce7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:10.833740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5197e4-24a6-4d7b-8a8a-5621622bcce7 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:10.838154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:10.839049 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:10.839331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:10.839602 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] PATH_INFO: `/v3/users/d23572ca3c474bd2b22c1d5ea72604c3` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:10.840766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23572ca3c474bd2b22c1d5ea72604c3)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:10.842720 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:10.886446 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23572ca3c474bd2b22c1d5ea72604c3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:10.893064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23572ca3c474bd2b22c1d5ea72604c3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:10.903927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23572ca3c474bd2b22c1d5ea72604c3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:10.904573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23572ca3c474bd2b22c1d5ea72604c3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:10.905170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23572ca3c474bd2b22c1d5ea72604c3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:10.917307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1279/2563] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:10 2022] DELETE /identity/v3/users/d23572ca3c474bd2b22c1d5ea72604c3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:10.922278 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c1b77-27a7-4389-ae29-b4a5274996a6 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:10.922749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c1b77-27a7-4389-ae29-b4a5274996a6 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:10.922870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c1b77-27a7-4389-ae29-b4a5274996a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:10.939120 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-390c1b77-27a7-4389-ae29-b4a5274996a6 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:10.940285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-390c1b77-27a7-4389-ae29-b4a5274996a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:10.996708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1285/2564] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:11.006296 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:11.007760 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:11.062788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1acdc-920a-49c5-9fa1-aecb6389254e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:11.066417 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a683-396a-4467-b622-5d79fb4df356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:11.067061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93a683-396a-4467-b622-5d79fb4df356 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:11.067339 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93a683-396a-4467-b622-5d79fb4df356 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:11.067611 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93a683-396a-4467-b622-5d79fb4df356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:11.076220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93a683-396a-4467-b622-5d79fb4df356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:11.077743 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93a683-396a-4467-b622-5d79fb4df356 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:11.087066 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1280/2565] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:11.344051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c1b77-27a7-4389-ae29-b4a5274996a6 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:11.346226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-390c1b77-27a7-4389-ae29-b4a5274996a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:11.363954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c1b77-27a7-4389-ae29-b4a5274996a6 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:11.369111 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:11.369977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:11.370295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:11.370644 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] PATH_INFO: `/v3/projects/2136d72bb49240c4800228cfe6aa66c9` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:11.371848 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2136d72bb49240c4800228cfe6aa66c9)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:11.373857 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:11.427666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2136d72bb49240c4800228cfe6aa66c9', 'request_id': 'req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.433011 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2136d72bb49240c4800228cfe6aa66c9', 'request_id': 'req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.440524 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2136d72bb49240c4800228cfe6aa66c9', 'request_id': 'req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.451138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] The token cache is being invalidate because project 2136d72bb49240c4800228cfe6aa66c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:11.451419 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.452022 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.454223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1286/2566] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:11 2022] DELETE /identity/v3/projects/2136d72bb49240c4800228cfe6aa66c9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:11.458115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a683-396a-4467-b622-5d79fb4df356 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:11.467607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a683-396a-4467-b622-5d79fb4df356 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:11.523173 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:11.523945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:11.524225 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:11.524496 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] PATH_INFO: `/v3/users/92fbad076a25445996b83c084d6360b2` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:11.525662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] RBAC: Authorizing `identity:delete_user(user_id=92fbad076a25445996b83c084d6360b2)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:11.527633 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:11.571550 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92fbad076a25445996b83c084d6360b2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.578989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92fbad076a25445996b83c084d6360b2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.592027 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92fbad076a25445996b83c084d6360b2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.592709 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92fbad076a25445996b83c084d6360b2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.593391 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92fbad076a25445996b83c084d6360b2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.605461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1281/2567] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:11 2022] DELETE /identity/v3/users/92fbad076a25445996b83c084d6360b2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:11.875335 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:11.876765 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:11.892977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1db6aa-066b-47f6-96f7-4eda897ccfa5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:11.948073 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:11.948927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:11.949208 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:11.949481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] PATH_INFO: `/v3/projects/dc4f107e3b2e49beb0bebed7400f71b6` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:11.950693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc4f107e3b2e49beb0bebed7400f71b6)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:11.952612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:11.996120 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc4f107e3b2e49beb0bebed7400f71b6', 'request_id': 'req-eb75321c-c636-4196-bd8d-556f80d2ff9d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.001887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc4f107e3b2e49beb0bebed7400f71b6', 'request_id': 'req-eb75321c-c636-4196-bd8d-556f80d2ff9d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.008135 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc4f107e3b2e49beb0bebed7400f71b6', 'request_id': 'req-eb75321c-c636-4196-bd8d-556f80d2ff9d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.018845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] The token cache is being invalidate because project dc4f107e3b2e49beb0bebed7400f71b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:12.019137 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.019761 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.021293 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1287/2568] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:11 2022] DELETE /identity/v3/projects/dc4f107e3b2e49beb0bebed7400f71b6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:12.025200 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.026643 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:12.038959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573eff1f-daad-4ce2-9576-a9b999bd669e admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.098889 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d148-6b53-44ef-9738-661a7ca63df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.099623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d148-6b53-44ef-9738-661a7ca63df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.100036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d148-6b53-44ef-9738-661a7ca63df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.100418 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d148-6b53-44ef-9738-661a7ca63df1 admin admin] PATH_INFO: `/v3/users/056b535183174d89ba64940ff3964902` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.101839 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d148-6b53-44ef-9738-661a7ca63df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=056b535183174d89ba64940ff3964902)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.103809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d148-6b53-44ef-9738-661a7ca63df1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.149244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-57c3d148-6b53-44ef-9738-661a7ca63df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '056b535183174d89ba64940ff3964902'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.155720 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-57c3d148-6b53-44ef-9738-661a7ca63df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '056b535183174d89ba64940ff3964902'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.166898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-57c3d148-6b53-44ef-9738-661a7ca63df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '056b535183174d89ba64940ff3964902'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.167595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-57c3d148-6b53-44ef-9738-661a7ca63df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '056b535183174d89ba64940ff3964902'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.168199 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-57c3d148-6b53-44ef-9738-661a7ca63df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '056b535183174d89ba64940ff3964902'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.182749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1282/2569] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:12 2022] DELETE /identity/v3/users/056b535183174d89ba64940ff3964902 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:12.452608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.454922 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:12.467223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75321c-c636-4196-bd8d-556f80d2ff9d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.523275 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efa77f-b111-4263-a256-98f768ea89cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.524168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efa77f-b111-4263-a256-98f768ea89cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.524450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efa77f-b111-4263-a256-98f768ea89cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.524725 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efa77f-b111-4263-a256-98f768ea89cc admin admin] PATH_INFO: `/v3/projects/68b9c2c7025342a68cb8272358958c35` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.525934 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efa77f-b111-4263-a256-98f768ea89cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b9c2c7025342a68cb8272358958c35)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.527878 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efa77f-b111-4263-a256-98f768ea89cc admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.572980 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a7efa77f-b111-4263-a256-98f768ea89cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b9c2c7025342a68cb8272358958c35', 'request_id': 'req-a7efa77f-b111-4263-a256-98f768ea89cc'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.578155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a7efa77f-b111-4263-a256-98f768ea89cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b9c2c7025342a68cb8272358958c35', 'request_id': 'req-a7efa77f-b111-4263-a256-98f768ea89cc'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.584804 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a7efa77f-b111-4263-a256-98f768ea89cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b9c2c7025342a68cb8272358958c35', 'request_id': 'req-a7efa77f-b111-4263-a256-98f768ea89cc'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.596067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a7efa77f-b111-4263-a256-98f768ea89cc admin admin] The token cache is being invalidate because project 68b9c2c7025342a68cb8272358958c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:12.596385 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a7efa77f-b111-4263-a256-98f768ea89cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.597001 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a7efa77f-b111-4263-a256-98f768ea89cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.598584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1288/2570] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:12 2022] DELETE /identity/v3/projects/68b9c2c7025342a68cb8272358958c35 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:12.603441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec1106-e490-463d-8411-f06584db293b None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.603731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec1106-e490-463d-8411-f06584db293b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.604007 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec1106-e490-463d-8411-f06584db293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.622430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-83ec1106-e490-463d-8411-f06584db293b None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:12.623541 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-83ec1106-e490-463d-8411-f06584db293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:12.678431 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1283/2571] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:12.740183 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3d54a-8fc3-4325-8df1-1d036bd05672 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.740475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3d54a-8fc3-4325-8df1-1d036bd05672 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.740756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3d54a-8fc3-4325-8df1-1d036bd05672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.759095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-adc3d54a-8fc3-4325-8df1-1d036bd05672 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:12.760272 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-adc3d54a-8fc3-4325-8df1-1d036bd05672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:12.768409 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1289/2572] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:12.772712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec1106-e490-463d-8411-f06584db293b None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.783035 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec1106-e490-463d-8411-f06584db293b None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.787623 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4b981-579d-4c35-91a4-7b72965c674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.788332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4b981-579d-4c35-91a4-7b72965c674a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.788619 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4b981-579d-4c35-91a4-7b72965c674a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.788894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4b981-579d-4c35-91a4-7b72965c674a admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.789633 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4b981-579d-4c35-91a4-7b72965c674a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:12.789922 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4b981-579d-4c35-91a4-7b72965c674a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.791579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4b981-579d-4c35-91a4-7b72965c674a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.802765 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1284/2573] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:12.807213 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3d54a-8fc3-4325-8df1-1d036bd05672 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.816474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3d54a-8fc3-4325-8df1-1d036bd05672 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.821689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fbc21-498c-431c-a2d1-48a1011bc25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.822376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fbc21-498c-431c-a2d1-48a1011bc25c admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.822658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fbc21-498c-431c-a2d1-48a1011bc25c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.822929 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fbc21-498c-431c-a2d1-48a1011bc25c admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.823627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fbc21-498c-431c-a2d1-48a1011bc25c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.825520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fbc21-498c-431c-a2d1-48a1011bc25c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.851271 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1290/2574] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:12 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:12.855384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4b981-579d-4c35-91a4-7b72965c674a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.865471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4b981-579d-4c35-91a4-7b72965c674a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.923169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8698594-23e5-4391-93fd-d8f1c3630d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.923711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8698594-23e5-4391-93fd-d8f1c3630d46 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.924145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8698594-23e5-4391-93fd-d8f1c3630d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.924273 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8698594-23e5-4391-93fd-d8f1c3630d46 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.924951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8698594-23e5-4391-93fd-d8f1c3630d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.926909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8698594-23e5-4391-93fd-d8f1c3630d46 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.946620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1285/2575] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:12 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:12.950609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fbc21-498c-431c-a2d1-48a1011bc25c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.960955 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fbc21-498c-431c-a2d1-48a1011bc25c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.965431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6d6a7-c5dd-4910-9429-b5305c55a75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.966073 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6d6a7-c5dd-4910-9429-b5305c55a75a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.966390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6d6a7-c5dd-4910-9429-b5305c55a75a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.966664 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6d6a7-c5dd-4910-9429-b5305c55a75a admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.967383 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6d6a7-c5dd-4910-9429-b5305c55a75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.969592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6d6a7-c5dd-4910-9429-b5305c55a75a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.979996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1291/2576] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:12.983826 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8698594-23e5-4391-93fd-d8f1c3630d46 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.994055 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8698594-23e5-4391-93fd-d8f1c3630d46 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.998716 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e188301-173b-44a5-9bb1-e0e8bb5e1387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.999366 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e188301-173b-44a5-9bb1-e0e8bb5e1387 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.999649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e188301-173b-44a5-9bb1-e0e8bb5e1387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.999920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e188301-173b-44a5-9bb1-e0e8bb5e1387 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.000637 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e188301-173b-44a5-9bb1-e0e8bb5e1387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:13.002238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e188301-173b-44a5-9bb1-e0e8bb5e1387 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:13.011676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1286/2577] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:13.016101 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6d6a7-c5dd-4910-9429-b5305c55a75a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:13.026404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6d6a7-c5dd-4910-9429-b5305c55a75a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:13.031667 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dec2e7-60fc-47be-8044-77870e404b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:13.032583 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dec2e7-60fc-47be-8044-77870e404b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.032862 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dec2e7-60fc-47be-8044-77870e404b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.033245 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dec2e7-60fc-47be-8044-77870e404b2b admin admin] PATH_INFO: `/v3/projects/0739c2a77846486e9f5692ee2690258e/users/ebda338d824e426a9d84bdc1a94c4173/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.047109 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dec2e7-60fc-47be-8044-77870e404b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0739c2a77846486e9f5692ee2690258e, user_id=ebda338d824e426a9d84bdc1a94c4173, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:13.049728 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dec2e7-60fc-47be-8044-77870e404b2b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:13.063434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1292/2578] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:13 2022] PUT /identity/v3/projects/0739c2a77846486e9f5692ee2690258e/users/ebda338d824e426a9d84bdc1a94c4173/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:13.073766 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21d4b-5e2d-4b3d-981b-6b23f46da473 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.074309 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21d4b-5e2d-4b3d-981b-6b23f46da473 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.074412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21d4b-5e2d-4b3d-981b-6b23f46da473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.102463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-0ca21d4b-5e2d-4b3d-981b-6b23f46da473 None None] MFA Rules not processed for user `ebda338d824e426a9d84bdc1a94c4173`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:13.103652 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0ca21d4b-5e2d-4b3d-981b-6b23f46da473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:13.165702 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1287/2579] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:13.175783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dec2e7-60fc-47be-8044-77870e404b2b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:13.177361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-53dec2e7-60fc-47be-8044-77870e404b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:13.233920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dec2e7-60fc-47be-8044-77870e404b2b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:13.237531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35902d86-90f0-48b4-8382-82b202c9f968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:13.238166 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35902d86-90f0-48b4-8382-82b202c9f968 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.238478 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35902d86-90f0-48b4-8382-82b202c9f968 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.238749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35902d86-90f0-48b4-8382-82b202c9f968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.246993 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35902d86-90f0-48b4-8382-82b202c9f968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:13.248411 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35902d86-90f0-48b4-8382-82b202c9f968 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:13.257304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1293/2580] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:13.282579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca21d4b-5e2d-4b3d-981b-6b23f46da473 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:13.342253 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca21d4b-5e2d-4b3d-981b-6b23f46da473 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:13.346957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:13.347823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.348105 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.348382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] PATH_INFO: `/v3/users/ebda338d824e426a9d84bdc1a94c4173` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.349576 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebda338d824e426a9d84bdc1a94c4173)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:13.351524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:13.397220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebda338d824e426a9d84bdc1a94c4173'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.403703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebda338d824e426a9d84bdc1a94c4173'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.415281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebda338d824e426a9d84bdc1a94c4173'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.415965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebda338d824e426a9d84bdc1a94c4173'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.416603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebda338d824e426a9d84bdc1a94c4173'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.428793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1288/2581] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:13 2022] DELETE /identity/v3/users/ebda338d824e426a9d84bdc1a94c4173 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:13.433358 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484420-1a88-4090-ab8f-723a5c712b3e None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.433647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484420-1a88-4090-ab8f-723a5c712b3e None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.433924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484420-1a88-4090-ab8f-723a5c712b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.451092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-26484420-1a88-4090-ab8f-723a5c712b3e None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:13.452264 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-26484420-1a88-4090-ab8f-723a5c712b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:13.511926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1294/2582] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:13.521486 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:13.522959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:13.577697 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9c4c1-1a6e-4839-84c5-8b637824409d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:13.581540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8453a-292e-4685-91fc-1a6d9a9f79d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:13.582182 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8453a-292e-4685-91fc-1a6d9a9f79d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.582499 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8453a-292e-4685-91fc-1a6d9a9f79d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.582778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8453a-292e-4685-91fc-1a6d9a9f79d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.591740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8453a-292e-4685-91fc-1a6d9a9f79d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:13.593181 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8453a-292e-4685-91fc-1a6d9a9f79d8 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:13.604765 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1289/2583] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:13.865223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26484420-1a88-4090-ab8f-723a5c712b3e None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:13.866671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-26484420-1a88-4090-ab8f-723a5c712b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:13.878423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26484420-1a88-4090-ab8f-723a5c712b3e None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:13.883454 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:13.884320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.884576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.884849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] PATH_INFO: `/v3/projects/0739c2a77846486e9f5692ee2690258e` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.886019 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0739c2a77846486e9f5692ee2690258e)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:13.887943 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:13.933634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0739c2a77846486e9f5692ee2690258e', 'request_id': 'req-3b49bd15-caa4-498e-af60-bb63ed0bd335'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.938868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0739c2a77846486e9f5692ee2690258e', 'request_id': 'req-3b49bd15-caa4-498e-af60-bb63ed0bd335'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.946373 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0739c2a77846486e9f5692ee2690258e', 'request_id': 'req-3b49bd15-caa4-498e-af60-bb63ed0bd335'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.956920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] The token cache is being invalidate because project 0739c2a77846486e9f5692ee2690258e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:13.957487 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.957832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.959377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1295/2584] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:13 2022] DELETE /identity/v3/projects/0739c2a77846486e9f5692ee2690258e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:33.105929 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8453a-292e-4685-91fc-1a6d9a9f79d8 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:33.107338 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f4b8453a-292e-4685-91fc-1a6d9a9f79d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:33.177495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8453a-292e-4685-91fc-1a6d9a9f79d8 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:33.238349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737103f-da2f-4f6e-b472-22760af905c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:33.238995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737103f-da2f-4f6e-b472-22760af905c6 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:33.239279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737103f-da2f-4f6e-b472-22760af905c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:33.239554 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737103f-da2f-4f6e-b472-22760af905c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:33.241819 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5737103f-da2f-4f6e-b472-22760af905c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:33.300293 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737103f-da2f-4f6e-b472-22760af905c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:33.301918 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737103f-da2f-4f6e-b472-22760af905c6 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:33.311777 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1290/2585] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:45.483325 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:45.486010 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:45.508003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49bd15-caa4-498e-af60-bb63ed0bd335 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:45.514819 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb808e-92a2-411f-8fe9-ed2db6bd393f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:45.515504 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb808e-92a2-411f-8fe9-ed2db6bd393f service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:45.515789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb808e-92a2-411f-8fe9-ed2db6bd393f service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:45.516103 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb808e-92a2-411f-8fe9-ed2db6bd393f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:45.518064 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a4cb808e-92a2-411f-8fe9-ed2db6bd393f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:45.538054 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb808e-92a2-411f-8fe9-ed2db6bd393f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:45.539909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb808e-92a2-411f-8fe9-ed2db6bd393f service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:45.552357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1296/2586] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:50.453017 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737103f-da2f-4f6e-b472-22760af905c6 service nova] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:50.455043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5737103f-da2f-4f6e-b472-22760af905c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:50.508141 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737103f-da2f-4f6e-b472-22760af905c6 service nova] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:50.511657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e392d1-f2d7-4c43-8321-06edc4cc1fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:50.512294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e392d1-f2d7-4c43-8321-06edc4cc1fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:50.512575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e392d1-f2d7-4c43-8321-06edc4cc1fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:50.512849 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e392d1-f2d7-4c43-8321-06edc4cc1fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:50.514616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-50e392d1-f2d7-4c43-8321-06edc4cc1fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:50.573341 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e392d1-f2d7-4c43-8321-06edc4cc1fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:50.574812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e392d1-f2d7-4c43-8321-06edc4cc1fc1 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:50.584715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1291/2587] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:51.135204 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c121e-bf87-4a7d-bfa7-6115d2ec8774 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:51.135708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c121e-bf87-4a7d-bfa7-6115d2ec8774 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:51.135814 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c121e-bf87-4a7d-bfa7-6115d2ec8774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:51.153909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c22c121e-bf87-4a7d-bfa7-6115d2ec8774 None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:51.155024 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c22c121e-bf87-4a7d-bfa7-6115d2ec8774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:51.211967 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1297/2588] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:43:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:51.224768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e392d1-f2d7-4c43-8321-06edc4cc1fc1 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:51.226660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-50e392d1-f2d7-4c43-8321-06edc4cc1fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:51.299106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e392d1-f2d7-4c43-8321-06edc4cc1fc1 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:51.305349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bebeda-5fee-4db5-bc4e-ac8e5e530bb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:51.305349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bebeda-5fee-4db5-bc4e-ac8e5e530bb4 service swift] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:51.305349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bebeda-5fee-4db5-bc4e-ac8e5e530bb4 service swift] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:51.305692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bebeda-5fee-4db5-bc4e-ac8e5e530bb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:51.314865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bebeda-5fee-4db5-bc4e-ac8e5e530bb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:51.316456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bebeda-5fee-4db5-bc4e-ac8e5e530bb4 service swift] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:51.325906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1292/2589] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:43:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:43:51.673394 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c121e-bf87-4a7d-bfa7-6115d2ec8774 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:51.708550 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c121e-bf87-4a7d-bfa7-6115d2ec8774 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:51.721321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1535622-c320-4ea9-a001-6a2e66b2b97c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:51.722099 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1535622-c320-4ea9-a001-6a2e66b2b97c service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:51.722556 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1535622-c320-4ea9-a001-6a2e66b2b97c service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:51.722939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1535622-c320-4ea9-a001-6a2e66b2b97c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:51.727060 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c1535622-c320-4ea9-a001-6a2e66b2b97c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:51.753512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1535622-c320-4ea9-a001-6a2e66b2b97c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:51.756084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1535622-c320-4ea9-a001-6a2e66b2b97c service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:51.773586 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1298/2590] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:54.761471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bebeda-5fee-4db5-bc4e-ac8e5e530bb4 service swift] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:54.762947 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e6bebeda-5fee-4db5-bc4e-ac8e5e530bb4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:54.795890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bebeda-5fee-4db5-bc4e-ac8e5e530bb4 service swift] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:54.801676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da690763-c58c-4d00-8297-af774b4fbb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:54.802767 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da690763-c58c-4d00-8297-af774b4fbb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:54.803237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da690763-c58c-4d00-8297-af774b4fbb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:54.803661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da690763-c58c-4d00-8297-af774b4fbb01 admin admin] PATH_INFO: `/v3/users/0c131301aa22491f8b1feb32d006ea62` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:54.805484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da690763-c58c-4d00-8297-af774b4fbb01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c131301aa22491f8b1feb32d006ea62)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:54.807548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da690763-c58c-4d00-8297-af774b4fbb01 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:54.879136 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-da690763-c58c-4d00-8297-af774b4fbb01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c131301aa22491f8b1feb32d006ea62'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:54.891207 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-da690763-c58c-4d00-8297-af774b4fbb01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c131301aa22491f8b1feb32d006ea62'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:54.903514 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-da690763-c58c-4d00-8297-af774b4fbb01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c131301aa22491f8b1feb32d006ea62'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:54.906037 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-da690763-c58c-4d00-8297-af774b4fbb01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c131301aa22491f8b1feb32d006ea62'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:54.906037 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-da690763-c58c-4d00-8297-af774b4fbb01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c131301aa22491f8b1feb32d006ea62'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:54.919072 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1293/2591] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:54 2022] DELETE /identity/v3/users/0c131301aa22491f8b1feb32d006ea62 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:55.124631 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1535622-c320-4ea9-a001-6a2e66b2b97c service nova] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.139942 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1535622-c320-4ea9-a001-6a2e66b2b97c service nova] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.209839 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.210766 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.211055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.211451 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80 admin admin] PATH_INFO: `/v3/projects/4c019a195f44431686f7ab8266e87ff2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.212640 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c019a195f44431686f7ab8266e87ff2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.214595 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.270056 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c019a195f44431686f7ab8266e87ff2', 'request_id': 'req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:55.275582 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c019a195f44431686f7ab8266e87ff2', 'request_id': 'req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:55.287693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c019a195f44431686f7ab8266e87ff2', 'request_id': 'req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:55.302173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80 admin admin] The token cache is being invalidate because project 4c019a195f44431686f7ab8266e87ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:55.302493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:55.303138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-c5c02284-cfc8-4857-9d0e-7df5d34d7c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:55.304952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1299/2592] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:55 2022] DELETE /identity/v3/projects/4c019a195f44431686f7ab8266e87ff2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:55.309615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cec8a8-1d00-403c-a7af-5c458d5bda42 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.310147 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cec8a8-1d00-403c-a7af-5c458d5bda42 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.310659 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cec8a8-1d00-403c-a7af-5c458d5bda42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.332018 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-b6cec8a8-1d00-403c-a7af-5c458d5bda42 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:55.334902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b6cec8a8-1d00-403c-a7af-5c458d5bda42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:55.421509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1294/2593] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:55.430861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae1714-6bb9-4965-a646-63d4fa6e7544 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.431155 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae1714-6bb9-4965-a646-63d4fa6e7544 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.431434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae1714-6bb9-4965-a646-63d4fa6e7544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.457095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-faae1714-6bb9-4965-a646-63d4fa6e7544 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:55.458317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-faae1714-6bb9-4965-a646-63d4fa6e7544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:55.490565 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1300/2594] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:55.492861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cec8a8-1d00-403c-a7af-5c458d5bda42 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.502906 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cec8a8-1d00-403c-a7af-5c458d5bda42 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.507735 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bfa69-7bfe-4f5b-9f6e-72d7ee7921b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.508478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bfa69-7bfe-4f5b-9f6e-72d7ee7921b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.508830 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bfa69-7bfe-4f5b-9f6e-72d7ee7921b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.509194 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bfa69-7bfe-4f5b-9f6e-72d7ee7921b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.509996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bfa69-7bfe-4f5b-9f6e-72d7ee7921b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:55.512865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bfa69-7bfe-4f5b-9f6e-72d7ee7921b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.512865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bfa69-7bfe-4f5b-9f6e-72d7ee7921b3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.531757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1295/2595] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:55.536315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae1714-6bb9-4965-a646-63d4fa6e7544 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.546342 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae1714-6bb9-4965-a646-63d4fa6e7544 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.551812 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b7173-29fb-488f-b89f-293deb3531ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.552474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b7173-29fb-488f-b89f-293deb3531ce admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.552755 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b7173-29fb-488f-b89f-293deb3531ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.553126 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b7173-29fb-488f-b89f-293deb3531ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.553901 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b7173-29fb-488f-b89f-293deb3531ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.557003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b7173-29fb-488f-b89f-293deb3531ce admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.590580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1301/2596] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:55 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:55.593038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bfa69-7bfe-4f5b-9f6e-72d7ee7921b3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.607242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bfa69-7bfe-4f5b-9f6e-72d7ee7921b3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.695569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517ba75-ab90-4de1-9506-bfbe1390d106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.696543 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517ba75-ab90-4de1-9506-bfbe1390d106 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.696823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517ba75-ab90-4de1-9506-bfbe1390d106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.697095 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517ba75-ab90-4de1-9506-bfbe1390d106 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.699417 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517ba75-ab90-4de1-9506-bfbe1390d106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.699817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517ba75-ab90-4de1-9506-bfbe1390d106 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.728752 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1296/2597] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:55 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:55.729917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b7173-29fb-488f-b89f-293deb3531ce admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.744506 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b7173-29fb-488f-b89f-293deb3531ce admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.752084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716b3fb-44d8-463c-83b7-82dfd6e40f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.752751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b3fb-44d8-463c-83b7-82dfd6e40f59 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.753031 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b3fb-44d8-463c-83b7-82dfd6e40f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.753303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b3fb-44d8-463c-83b7-82dfd6e40f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.754029 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716b3fb-44d8-463c-83b7-82dfd6e40f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.755702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716b3fb-44d8-463c-83b7-82dfd6e40f59 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.770829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1302/2598] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:55.774690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517ba75-ab90-4de1-9506-bfbe1390d106 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.786432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517ba75-ab90-4de1-9506-bfbe1390d106 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.791337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f025-cf1b-4536-b050-5a5c6c2c66b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.792006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f025-cf1b-4536-b050-5a5c6c2c66b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.792288 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f025-cf1b-4536-b050-5a5c6c2c66b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.792562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f025-cf1b-4536-b050-5a5c6c2c66b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.793396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0f025-cf1b-4536-b050-5a5c6c2c66b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.795118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0f025-cf1b-4536-b050-5a5c6c2c66b8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.809307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1297/2599] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:55.810870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716b3fb-44d8-463c-83b7-82dfd6e40f59 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.822224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716b3fb-44d8-463c-83b7-82dfd6e40f59 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.827081 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55ca64-8edb-45cd-b56a-10698cb6b9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.827977 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55ca64-8edb-45cd-b56a-10698cb6b9aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.828570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55ca64-8edb-45cd-b56a-10698cb6b9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.828862 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55ca64-8edb-45cd-b56a-10698cb6b9aa admin admin] PATH_INFO: `/v3/projects/5428110a1c5d4a40bf7547084a1ead06/users/97e5d5e11cc74250bc2180d0484fa21b/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.846470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55ca64-8edb-45cd-b56a-10698cb6b9aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5428110a1c5d4a40bf7547084a1ead06, user_id=97e5d5e11cc74250bc2180d0484fa21b, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.849387 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55ca64-8edb-45cd-b56a-10698cb6b9aa admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.865341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1303/2600] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:55 2022] PUT /identity/v3/projects/5428110a1c5d4a40bf7547084a1ead06/users/97e5d5e11cc74250bc2180d0484fa21b/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:55.876315 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31320c-cae6-4c35-8261-65069dffa406 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.876608 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31320c-cae6-4c35-8261-65069dffa406 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.876878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31320c-cae6-4c35-8261-65069dffa406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.911100 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-9a31320c-cae6-4c35-8261-65069dffa406 None None] MFA Rules not processed for user `97e5d5e11cc74250bc2180d0484fa21b`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:55.912286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9a31320c-cae6-4c35-8261-65069dffa406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:56.002006 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1298/2601] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:56.003585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55ca64-8edb-45cd-b56a-10698cb6b9aa admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:56.094559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55ca64-8edb-45cd-b56a-10698cb6b9aa admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:56.103313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de79020-7602-4f2e-bd28-fdc1607ad70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:56.104113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79020-7602-4f2e-bd28-fdc1607ad70e admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:56.104522 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79020-7602-4f2e-bd28-fdc1607ad70e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:56.104820 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79020-7602-4f2e-bd28-fdc1607ad70e admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:56.105750 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de79020-7602-4f2e-bd28-fdc1607ad70e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:56.107710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de79020-7602-4f2e-bd28-fdc1607ad70e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:56.138163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1304/2602] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:56 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:56.142746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31320c-cae6-4c35-8261-65069dffa406 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:56.153799 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31320c-cae6-4c35-8261-65069dffa406 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:56.216813 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aaa5b-7787-4ccb-8ec4-929ddb53fbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:56.217899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aaa5b-7787-4ccb-8ec4-929ddb53fbdf admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:56.218182 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aaa5b-7787-4ccb-8ec4-929ddb53fbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:56.218481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aaa5b-7787-4ccb-8ec4-929ddb53fbdf admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:56.219778 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0aaa5b-7787-4ccb-8ec4-929ddb53fbdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:56.221708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0aaa5b-7787-4ccb-8ec4-929ddb53fbdf admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:56.246843 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1299/2603] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:56 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:56.250991 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de79020-7602-4f2e-bd28-fdc1607ad70e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:56.261943 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de79020-7602-4f2e-bd28-fdc1607ad70e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:56.267349 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040ed8-40df-4411-a213-8377950c3889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:56.268020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040ed8-40df-4411-a213-8377950c3889 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:56.268305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040ed8-40df-4411-a213-8377950c3889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:56.269311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040ed8-40df-4411-a213-8377950c3889 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:56.270063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040ed8-40df-4411-a213-8377950c3889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:56.271726 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040ed8-40df-4411-a213-8377950c3889 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:56.284099 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1305/2604] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:56.292365 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aaa5b-7787-4ccb-8ec4-929ddb53fbdf admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:56.302603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aaa5b-7787-4ccb-8ec4-929ddb53fbdf admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:56.308338 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31f060-079e-47e7-bf6d-4d71cb319b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:56.309968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31f060-079e-47e7-bf6d-4d71cb319b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:56.310338 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31f060-079e-47e7-bf6d-4d71cb319b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:56.310670 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31f060-079e-47e7-bf6d-4d71cb319b41 admin admin] PATH_INFO: `/v3/projects/5a4e002e0d4e44a287576880a3b27f63/users/5970f79ff2954ee0b025118e7181a3de/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:56.330511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31f060-079e-47e7-bf6d-4d71cb319b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4e002e0d4e44a287576880a3b27f63, user_id=5970f79ff2954ee0b025118e7181a3de, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:56.333217 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31f060-079e-47e7-bf6d-4d71cb319b41 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:56.354350 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1300/2605] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:56 2022] PUT /identity/v3/projects/5a4e002e0d4e44a287576880a3b27f63/users/5970f79ff2954ee0b025118e7181a3de/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:56.355024 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040ed8-40df-4411-a213-8377950c3889 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:56.365908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040ed8-40df-4411-a213-8377950c3889 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:56.434714 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7989bb-5fd3-47d7-8a40-b295f691f030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:56.435397 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7989bb-5fd3-47d7-8a40-b295f691f030 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:56.435700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7989bb-5fd3-47d7-8a40-b295f691f030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:56.435957 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7989bb-5fd3-47d7-8a40-b295f691f030 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:56.436757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7989bb-5fd3-47d7-8a40-b295f691f030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:56.438558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7989bb-5fd3-47d7-8a40-b295f691f030 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:56.451416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1306/2606] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:56.456107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31f060-079e-47e7-bf6d-4d71cb319b41 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:56.469656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31f060-079e-47e7-bf6d-4d71cb319b41 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:56.474719 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75590f-93f6-449a-ac79-cfe2e6d5ad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:56.475731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75590f-93f6-449a-ac79-cfe2e6d5ad39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:56.476024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75590f-93f6-449a-ac79-cfe2e6d5ad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:56.476300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75590f-93f6-449a-ac79-cfe2e6d5ad39 admin admin] PATH_INFO: `/v3/projects/5a4e002e0d4e44a287576880a3b27f63/users/5970f79ff2954ee0b025118e7181a3de/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:56.478344 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75590f-93f6-449a-ac79-cfe2e6d5ad39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4e002e0d4e44a287576880a3b27f63, user_id=5970f79ff2954ee0b025118e7181a3de, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:56.480984 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75590f-93f6-449a-ac79-cfe2e6d5ad39 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:56.493780 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1301/2607] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:56 2022] PUT /identity/v3/projects/5a4e002e0d4e44a287576880a3b27f63/users/5970f79ff2954ee0b025118e7181a3de/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:56.505362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966991c-166d-4967-938b-1b32d3f36d6d None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:56.505839 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966991c-166d-4967-938b-1b32d3f36d6d None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:56.506074 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966991c-166d-4967-938b-1b32d3f36d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:56.538884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-8966991c-166d-4967-938b-1b32d3f36d6d None None] MFA Rules not processed for user `5970f79ff2954ee0b025118e7181a3de`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:56.540397 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8966991c-166d-4967-938b-1b32d3f36d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:56.623650 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1307/2608] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:43:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:56.630463 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75590f-93f6-449a-ac79-cfe2e6d5ad39 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:56.633962 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6e75590f-93f6-449a-ac79-cfe2e6d5ad39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:56.709356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75590f-93f6-449a-ac79-cfe2e6d5ad39 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:56.714759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f914733-da43-4f5a-8037-fb64f98f3970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:56.715431 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f914733-da43-4f5a-8037-fb64f98f3970 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:56.715722 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f914733-da43-4f5a-8037-fb64f98f3970 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:56.716001 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f914733-da43-4f5a-8037-fb64f98f3970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:56.726039 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f914733-da43-4f5a-8037-fb64f98f3970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:56.727516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f914733-da43-4f5a-8037-fb64f98f3970 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:56.741258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1302/2609] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:56.840783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966991c-166d-4967-938b-1b32d3f36d6d None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:56.854092 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966991c-166d-4967-938b-1b32d3f36d6d None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:56.865283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c433b5f-b16f-4950-8177-5ced03a13c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:56.866255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c433b5f-b16f-4950-8177-5ced03a13c9a service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:56.866776 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c433b5f-b16f-4950-8177-5ced03a13c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:56.867212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c433b5f-b16f-4950-8177-5ced03a13c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:56.935710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c433b5f-b16f-4950-8177-5ced03a13c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:56.937299 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c433b5f-b16f-4950-8177-5ced03a13c9a service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:56.947864 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1308/2610] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:03.405025 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f914733-da43-4f5a-8037-fb64f98f3970 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:03.406575 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6f914733-da43-4f5a-8037-fb64f98f3970 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:03.462235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f914733-da43-4f5a-8037-fb64f98f3970 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:03.465855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c145d-092a-44d2-bb16-d7e418c8a9fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:03.466535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c145d-092a-44d2-bb16-d7e418c8a9fb service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:03.466821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c145d-092a-44d2-bb16-d7e418c8a9fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:03.467095 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c145d-092a-44d2-bb16-d7e418c8a9fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:03.468885 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9f0c145d-092a-44d2-bb16-d7e418c8a9fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:03.478286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c145d-092a-44d2-bb16-d7e418c8a9fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:03.479711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c145d-092a-44d2-bb16-d7e418c8a9fb service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:03.487654 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1303/2611] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:06.092834 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c433b5f-b16f-4950-8177-5ced03a13c9a service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:06.159727 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c433b5f-b16f-4950-8177-5ced03a13c9a service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:06.164226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:06.165084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:06.165363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:06.165635 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] PATH_INFO: `/v3/users/97e5d5e11cc74250bc2180d0484fa21b` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:06.166815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e5d5e11cc74250bc2180d0484fa21b)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:06.168711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:06.213069 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e5d5e11cc74250bc2180d0484fa21b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.220418 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e5d5e11cc74250bc2180d0484fa21b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.231751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e5d5e11cc74250bc2180d0484fa21b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.232376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e5d5e11cc74250bc2180d0484fa21b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.239912 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e5d5e11cc74250bc2180d0484fa21b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.245637 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1309/2612] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:44:06 2022] DELETE /identity/v3/users/97e5d5e11cc74250bc2180d0484fa21b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:44:06.250291 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d949a6-0209-43b8-8150-ee29859b7b17 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:06.250790 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d949a6-0209-43b8-8150-ee29859b7b17 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:06.250895 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d949a6-0209-43b8-8150-ee29859b7b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:06.268658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-64d949a6-0209-43b8-8150-ee29859b7b17 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:06.269823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-64d949a6-0209-43b8-8150-ee29859b7b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:06.327081 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1304/2613] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:06.336684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:06.338090 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:06.394786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335ec5e-7279-4302-b1f0-02d09805d079 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:06.398389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d5e46-ca22-43d0-b766-86bfc77c3902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:06.399037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d5e46-ca22-43d0-b766-86bfc77c3902 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:06.399319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d5e46-ca22-43d0-b766-86bfc77c3902 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:06.399598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d5e46-ca22-43d0-b766-86bfc77c3902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:06.409404 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d5e46-ca22-43d0-b766-86bfc77c3902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:06.410888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d5e46-ca22-43d0-b766-86bfc77c3902 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:06.420759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1310/2614] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:06.699090 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d949a6-0209-43b8-8150-ee29859b7b17 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:06.700523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-64d949a6-0209-43b8-8150-ee29859b7b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:06.722693 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d949a6-0209-43b8-8150-ee29859b7b17 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:06.729367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:06.730509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:06.730848 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:06.731168 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9 admin admin] PATH_INFO: `/v3/projects/5428110a1c5d4a40bf7547084a1ead06` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:06.732418 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5428110a1c5d4a40bf7547084a1ead06)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:06.734894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:06.780305 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5428110a1c5d4a40bf7547084a1ead06', 'request_id': 'req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.786856 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5428110a1c5d4a40bf7547084a1ead06', 'request_id': 'req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.794484 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5428110a1c5d4a40bf7547084a1ead06', 'request_id': 'req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.805168 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9 admin admin] The token cache is being invalidate because project 5428110a1c5d4a40bf7547084a1ead06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:44:06.805452 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.806074 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8bfc07b1-b54a-4c5d-9f5a-53d42f7657d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.807660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1305/2615] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:44:06 2022] DELETE /identity/v3/projects/5428110a1c5d4a40bf7547084a1ead06 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:06.811679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d5e46-ca22-43d0-b766-86bfc77c3902 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:06.821083 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d5e46-ca22-43d0-b766-86bfc77c3902 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:06.880558 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:06.881433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:06.881707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:06.881985 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] PATH_INFO: `/v3/users/5970f79ff2954ee0b025118e7181a3de` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:06.883205 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5970f79ff2954ee0b025118e7181a3de)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:06.885113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:06.930872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5970f79ff2954ee0b025118e7181a3de'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.939141 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5970f79ff2954ee0b025118e7181a3de'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.951491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5970f79ff2954ee0b025118e7181a3de'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.952289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5970f79ff2954ee0b025118e7181a3de'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.959746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5970f79ff2954ee0b025118e7181a3de'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:06.965505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1311/2616] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:44:06 2022] DELETE /identity/v3/users/5970f79ff2954ee0b025118e7181a3de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:07.245908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bb707-eefb-405f-935e-14aab4a4fe19 None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.245908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bb707-eefb-405f-935e-14aab4a4fe19 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.245908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bb707-eefb-405f-935e-14aab4a4fe19 None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.247216 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:07.250831 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:07.252538 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1306/2617] 10.222.0.79 () {54 vars in 921 bytes} [Mon Feb 21 01:44:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:44:07.265135 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829df6e1-ec27-4134-85b5-9d5dc28b8a77 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.265507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829df6e1-ec27-4134-85b5-9d5dc28b8a77 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.266960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829df6e1-ec27-4134-85b5-9d5dc28b8a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.307813 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-829df6e1-ec27-4134-85b5-9d5dc28b8a77 None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:07.309238 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-829df6e1-ec27-4134-85b5-9d5dc28b8a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:07.331636 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a5139-d463-495c-bd31-da966caf00bd admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:07.336377 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8062987-f949-45f4-b121-2b87a4e60545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:07.337396 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8062987-f949-45f4-b121-2b87a4e60545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.337548 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8062987-f949-45f4-b121-2b87a4e60545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.337887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8062987-f949-45f4-b121-2b87a4e60545 admin admin] PATH_INFO: `/v3/projects/5a4e002e0d4e44a287576880a3b27f63` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.339501 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8062987-f949-45f4-b121-2b87a4e60545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4e002e0d4e44a287576880a3b27f63)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:07.341452 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8062987-f949-45f4-b121-2b87a4e60545 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:07.384395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1307/2618] 10.222.0.79 () {58 vars in 1018 bytes} [Mon Feb 21 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:44:07.392447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-f8062987-f949-45f4-b121-2b87a4e60545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4e002e0d4e44a287576880a3b27f63', 'request_id': 'req-f8062987-f949-45f4-b121-2b87a4e60545'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:07.396941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829df6e1-ec27-4134-85b5-9d5dc28b8a77 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:07.398395 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-829df6e1-ec27-4134-85b5-9d5dc28b8a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:07.399723 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-f8062987-f949-45f4-b121-2b87a4e60545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4e002e0d4e44a287576880a3b27f63', 'request_id': 'req-f8062987-f949-45f4-b121-2b87a4e60545'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:07.407000 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-f8062987-f949-45f4-b121-2b87a4e60545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4e002e0d4e44a287576880a3b27f63', 'request_id': 'req-f8062987-f949-45f4-b121-2b87a4e60545'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:07.423856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-f8062987-f949-45f4-b121-2b87a4e60545 admin admin] The token cache is being invalidate because project 5a4e002e0d4e44a287576880a3b27f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:44:07.424154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-f8062987-f949-45f4-b121-2b87a4e60545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:07.424827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-f8062987-f949-45f4-b121-2b87a4e60545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:07.426484 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1312/2619] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:44:07 2022] DELETE /identity/v3/projects/5a4e002e0d4e44a287576880a3b27f63 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:07.432336 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeef18-9618-469c-a1a3-3fb85b4f7328 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.432695 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeef18-9618-469c-a1a3-3fb85b4f7328 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.432984 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeef18-9618-469c-a1a3-3fb85b4f7328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.451489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-94eeef18-9618-469c-a1a3-3fb85b4f7328 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:07.452671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-94eeef18-9618-469c-a1a3-3fb85b4f7328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:07.476367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829df6e1-ec27-4134-85b5-9d5dc28b8a77 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:07.511233 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1313/2620] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:44:07.518908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8298103-1493-4638-93a7-3dc3a1c8b12a None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.519188 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8298103-1493-4638-93a7-3dc3a1c8b12a None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.519458 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8298103-1493-4638-93a7-3dc3a1c8b12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.529347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6878a7-f01e-4ba5-ac8f-db6f9754982e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68b3bc64dc94865a72cea0988fa9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:07.529999 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6878a7-f01e-4ba5-ac8f-db6f9754982e service glance] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.530330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6878a7-f01e-4ba5-ac8f-db6f9754982e service glance] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.530612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6878a7-f01e-4ba5-ac8f-db6f9754982e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.532422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ae6878a7-f01e-4ba5-ac8f-db6f9754982e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:07.537302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a8298103-1493-4638-93a7-3dc3a1c8b12a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:07.538499 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a8298103-1493-4638-93a7-3dc3a1c8b12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:07.546549 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1314/2621] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:44:07.551030 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8298103-1493-4638-93a7-3dc3a1c8b12a None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:07.559683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8298103-1493-4638-93a7-3dc3a1c8b12a None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:07.565039 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cede4-3b97-4881-9733-9e58b2056a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:07.565668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cede4-3b97-4881-9733-9e58b2056a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.565947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cede4-3b97-4881-9733-9e58b2056a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.566238 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cede4-3b97-4881-9733-9e58b2056a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.566959 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cede4-3b97-4881-9733-9e58b2056a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:44:07.567260 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cede4-3b97-4881-9733-9e58b2056a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:07.568864 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cede4-3b97-4881-9733-9e58b2056a9f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:07.580935 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1315/2622] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:44:07.584953 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cede4-3b97-4881-9733-9e58b2056a9f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:07.594306 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cede4-3b97-4881-9733-9e58b2056a9f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:07.598851 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdff171-8c02-4d90-934c-427ebe84b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:07.599473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdff171-8c02-4d90-934c-427ebe84b4fc admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.599763 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdff171-8c02-4d90-934c-427ebe84b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.600035 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdff171-8c02-4d90-934c-427ebe84b4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.600712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdff171-8c02-4d90-934c-427ebe84b4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:07.602059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6878a7-f01e-4ba5-ac8f-db6f9754982e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:07.602653 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdff171-8c02-4d90-934c-427ebe84b4fc admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:07.603524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6878a7-f01e-4ba5-ac8f-db6f9754982e service glance] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:07.614675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1308/2623] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:44:07.630887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1316/2624] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:44:07 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:44:07.635240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6878a7-f01e-4ba5-ac8f-db6f9754982e service glance] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:07.646260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6878a7-f01e-4ba5-ac8f-db6f9754982e service glance] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:07.682814 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7a814-65ac-4054-b70e-0855347bbdaf None None] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.683189 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7a814-65ac-4054-b70e-0855347bbdaf None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.683534 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7a814-65ac-4054-b70e-0855347bbdaf None None] PATH_INFO: `/` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.685455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1317/2625] 10.222.0.79 () {54 vars in 921 bytes} [Mon Feb 21 01:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:44:07.691003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c95f4-2f76-4eb6-80ce-9e2e7cf25755 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.691339 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c95f4-2f76-4eb6-80ce-9e2e7cf25755 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.691618 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c95f4-2f76-4eb6-80ce-9e2e7cf25755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.703526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0ba7e-85c9-4ca8-aaac-878879efa13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:07.704352 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0ba7e-85c9-4ca8-aaac-878879efa13a admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.704635 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0ba7e-85c9-4ca8-aaac-878879efa13a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.704943 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0ba7e-85c9-4ca8-aaac-878879efa13a admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.705726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0ba7e-85c9-4ca8-aaac-878879efa13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:07.708121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0ba7e-85c9-4ca8-aaac-878879efa13a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:07.710443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-563c95f4-2f76-4eb6-80ce-9e2e7cf25755 None None] MFA Rules not processed for user `3f00b174c88547e2ab799d89a50d5b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:07.711706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-563c95f4-2f76-4eb6-80ce-9e2e7cf25755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:07.730954 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1309/2626] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:44:07 2022] POST /identity/v3/users => generated 305 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:44:07.732217 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0ba7e-85c9-4ca8-aaac-878879efa13a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:07.742746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0ba7e-85c9-4ca8-aaac-878879efa13a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:07.747504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bd5c4-561c-4886-b6d5-6f313c2520b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:07.748150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bd5c4-561c-4886-b6d5-6f313c2520b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.748430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bd5c4-561c-4886-b6d5-6f313c2520b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.748703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bd5c4-561c-4886-b6d5-6f313c2520b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.749429 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bd5c4-561c-4886-b6d5-6f313c2520b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:07.751092 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bd5c4-561c-4886-b6d5-6f313c2520b0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:07.760823 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1310/2627] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:44:07.764740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bd5c4-561c-4886-b6d5-6f313c2520b0 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:07.769244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1318/2628] 10.222.0.79 () {58 vars in 1018 bytes} [Mon Feb 21 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:44:07.774048 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bd5c4-561c-4886-b6d5-6f313c2520b0 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:07.779890 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f65a8-37da-4603-87b8-081c81781fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:07.780547 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f65a8-37da-4603-87b8-081c81781fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.780666 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c95f4-2f76-4eb6-80ce-9e2e7cf25755 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:07.780829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f65a8-37da-4603-87b8-081c81781fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.781101 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f65a8-37da-4603-87b8-081c81781fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.782375 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f65a8-37da-4603-87b8-081c81781fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:07.782635 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-563c95f4-2f76-4eb6-80ce-9e2e7cf25755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:07.783945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f65a8-37da-4603-87b8-081c81781fa0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:07.792657 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c95f4-2f76-4eb6-80ce-9e2e7cf25755 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:07.794276 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1311/2629] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:44:07.798914 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f65a8-37da-4603-87b8-081c81781fa0 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:07.800083 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69164604-f8db-4328-b6d7-92950644c152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:07.800802 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69164604-f8db-4328-b6d7-92950644c152 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.801181 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69164604-f8db-4328-b6d7-92950644c152 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.801456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69164604-f8db-4328-b6d7-92950644c152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.808089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f65a8-37da-4603-87b8-081c81781fa0 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:07.808995 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69164604-f8db-4328-b6d7-92950644c152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:07.810457 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69164604-f8db-4328-b6d7-92950644c152 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:07.812772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee6819-39a9-46d5-94b6-e31e2b935e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:07.813612 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee6819-39a9-46d5-94b6-e31e2b935e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.813889 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee6819-39a9-46d5-94b6-e31e2b935e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.814162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee6819-39a9-46d5-94b6-e31e2b935e55 admin admin] PATH_INFO: `/v3/projects/b10e0f6646164cd6a3c196c1cf71dc89/users/46a0f0d383be4c5794d34ec3c0e7c996/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.818329 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1319/2630] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:44:07.828283 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee6819-39a9-46d5-94b6-e31e2b935e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10e0f6646164cd6a3c196c1cf71dc89, user_id=46a0f0d383be4c5794d34ec3c0e7c996, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:07.830973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee6819-39a9-46d5-94b6-e31e2b935e55 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:07.844638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1312/2631] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:44:07 2022] PUT /identity/v3/projects/b10e0f6646164cd6a3c196c1cf71dc89/users/46a0f0d383be4c5794d34ec3c0e7c996/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:44:07.854651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa11f7a-257d-4fea-9f0e-96883b94bb2b None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.854947 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa11f7a-257d-4fea-9f0e-96883b94bb2b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.855228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa11f7a-257d-4fea-9f0e-96883b94bb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.881872 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-2aa11f7a-257d-4fea-9f0e-96883b94bb2b None None] MFA Rules not processed for user `46a0f0d383be4c5794d34ec3c0e7c996`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:07.883195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-2aa11f7a-257d-4fea-9f0e-96883b94bb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:07.907120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf859c-a911-4dc2-8480-3376cd2f63de None None] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.907520 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf859c-a911-4dc2-8480-3376cd2f63de None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.908300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf859c-a911-4dc2-8480-3376cd2f63de None None] PATH_INFO: `/` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.910496 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1313/2632] 10.222.0.79 () {54 vars in 921 bytes} [Mon Feb 21 01:44:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:44:07.916249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51dd08-2e46-4e51-b92b-acc11b989d4e None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:07.916543 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51dd08-2e46-4e51-b92b-acc11b989d4e None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:07.916798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51dd08-2e46-4e51-b92b-acc11b989d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:07.935112 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-ab51dd08-2e46-4e51-b92b-acc11b989d4e None None] MFA Rules not processed for user `333ec5b3842b432a99bc265abbe7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:07.936286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ab51dd08-2e46-4e51-b92b-acc11b989d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:07.947493 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1320/2633] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:07.951901 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa11f7a-257d-4fea-9f0e-96883b94bb2b None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:08.003330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1314/2634] 10.222.0.79 () {58 vars in 1018 bytes} [Mon Feb 21 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:44:08.012503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa11f7a-257d-4fea-9f0e-96883b94bb2b None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:08.013709 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51dd08-2e46-4e51-b92b-acc11b989d4e None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:08.015220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ab51dd08-2e46-4e51-b92b-acc11b989d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:08.017268 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fffd91-9e82-4d8d-a19d-3d0b5d2072ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:08.017926 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fffd91-9e82-4d8d-a19d-3d0b5d2072ff admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:08.018221 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fffd91-9e82-4d8d-a19d-3d0b5d2072ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:08.018527 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fffd91-9e82-4d8d-a19d-3d0b5d2072ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:08.019224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fffd91-9e82-4d8d-a19d-3d0b5d2072ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:08.021270 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fffd91-9e82-4d8d-a19d-3d0b5d2072ff admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:08.048286 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1321/2635] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:44:07 2022] POST /identity/v3/projects => generated 409 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:44:08.052110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fffd91-9e82-4d8d-a19d-3d0b5d2072ff admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:08.074501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51dd08-2e46-4e51-b92b-acc11b989d4e None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:08.112446 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fffd91-9e82-4d8d-a19d-3d0b5d2072ff admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:08.117505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232412d3-fcaa-4e02-b625-7061b08b46b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:08.118174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232412d3-fcaa-4e02-b625-7061b08b46b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:08.118488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232412d3-fcaa-4e02-b625-7061b08b46b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:08.118762 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232412d3-fcaa-4e02-b625-7061b08b46b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:08.119453 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232412d3-fcaa-4e02-b625-7061b08b46b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:08.121384 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232412d3-fcaa-4e02-b625-7061b08b46b2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:08.128076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aac7a3-b1c6-4a96-96b8-ad91a8680f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:08.128727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aac7a3-b1c6-4a96-96b8-ad91a8680f03 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:08.129008 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aac7a3-b1c6-4a96-96b8-ad91a8680f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:08.129314 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aac7a3-b1c6-4a96-96b8-ad91a8680f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:08.142780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1322/2636] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:44:08 2022] POST /identity/v3/users => generated 311 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:44:08.146475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232412d3-fcaa-4e02-b625-7061b08b46b2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:08.155787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232412d3-fcaa-4e02-b625-7061b08b46b2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:08.160978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8684a-65c7-4b53-94fe-c82b8478003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:08.161612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8684a-65c7-4b53-94fe-c82b8478003c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:08.161898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8684a-65c7-4b53-94fe-c82b8478003c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:08.162171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8684a-65c7-4b53-94fe-c82b8478003c admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:08.163037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8684a-65c7-4b53-94fe-c82b8478003c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:08.164632 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8684a-65c7-4b53-94fe-c82b8478003c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:08.177270 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1323/2637] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:44:08.178196 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8684a-65c7-4b53-94fe-c82b8478003c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:08.187406 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8684a-65c7-4b53-94fe-c82b8478003c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:08.191946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d10217-7271-4cc5-8000-8bb1ad1d7662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:08.192777 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d10217-7271-4cc5-8000-8bb1ad1d7662 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:08.193058 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d10217-7271-4cc5-8000-8bb1ad1d7662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:08.193333 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d10217-7271-4cc5-8000-8bb1ad1d7662 admin admin] PATH_INFO: `/v3/projects/9216cc88e05d4f92a0ccf4b4da6a397d/users/736d77bc76734e37980d1482719c71c2/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:08.198507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aac7a3-b1c6-4a96-96b8-ad91a8680f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:08.199957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aac7a3-b1c6-4a96-96b8-ad91a8680f03 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:08.209274 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d10217-7271-4cc5-8000-8bb1ad1d7662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9216cc88e05d4f92a0ccf4b4da6a397d, user_id=736d77bc76734e37980d1482719c71c2, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:08.211943 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d10217-7271-4cc5-8000-8bb1ad1d7662 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:08.213910 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1315/2638] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:44:08.225939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1324/2639] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:44:08 2022] PUT /identity/v3/projects/9216cc88e05d4f92a0ccf4b4da6a397d/users/736d77bc76734e37980d1482719c71c2/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:44:08.229798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aac7a3-b1c6-4a96-96b8-ad91a8680f03 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:08.240303 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aac7a3-b1c6-4a96-96b8-ad91a8680f03 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:08.276807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d10217-7271-4cc5-8000-8bb1ad1d7662 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:08.278678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-25d10217-7271-4cc5-8000-8bb1ad1d7662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:08.297213 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b41a6-ae05-4a3b-934b-e0f163c6c335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:08.297991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b41a6-ae05-4a3b-934b-e0f163c6c335 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:08.298649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b41a6-ae05-4a3b-934b-e0f163c6c335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:08.298649 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b41a6-ae05-4a3b-934b-e0f163c6c335 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:08.299318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b41a6-ae05-4a3b-934b-e0f163c6c335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:08.300909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b41a6-ae05-4a3b-934b-e0f163c6c335 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:08.310613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1316/2640] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:08.314535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b41a6-ae05-4a3b-934b-e0f163c6c335 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:08.324023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b41a6-ae05-4a3b-934b-e0f163c6c335 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:08.329322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7266b5-ca34-4a34-a9be-92a245959d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:08.330216 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7266b5-ca34-4a34-a9be-92a245959d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:08.330495 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7266b5-ca34-4a34-a9be-92a245959d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:08.330771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7266b5-ca34-4a34-a9be-92a245959d7f admin admin] PATH_INFO: `/v3/projects/9216cc88e05d4f92a0ccf4b4da6a397d/users/736d77bc76734e37980d1482719c71c2/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:08.332695 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7266b5-ca34-4a34-a9be-92a245959d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9216cc88e05d4f92a0ccf4b4da6a397d, user_id=736d77bc76734e37980d1482719c71c2, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:08.335470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7266b5-ca34-4a34-a9be-92a245959d7f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:08.345960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1317/2641] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:44:08 2022] PUT /identity/v3/projects/9216cc88e05d4f92a0ccf4b4da6a397d/users/736d77bc76734e37980d1482719c71c2/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:08.347567 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d10217-7271-4cc5-8000-8bb1ad1d7662 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:08.357174 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ae64-fe0a-4ee9-a12e-0e56fd7297be None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:08.357462 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ae64-fe0a-4ee9-a12e-0e56fd7297be None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:08.357731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ae64-fe0a-4ee9-a12e-0e56fd7297be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:08.383074 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-8dd9ae64-fe0a-4ee9-a12e-0e56fd7297be None None] MFA Rules not processed for user `736d77bc76734e37980d1482719c71c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:08.384260 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8dd9ae64-fe0a-4ee9-a12e-0e56fd7297be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:08.404870 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab41899-70c3-4d3e-b33e-672b55f1d93a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02e7385005924d4f8c220c986b9866de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:08.405597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41899-70c3-4d3e-b33e-672b55f1d93a service placement] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:08.405942 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41899-70c3-4d3e-b33e-672b55f1d93a service placement] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:08.406884 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41899-70c3-4d3e-b33e-672b55f1d93a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:08.408806 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8ab41899-70c3-4d3e-b33e-672b55f1d93a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:08.420390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab41899-70c3-4d3e-b33e-672b55f1d93a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:08.422125 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab41899-70c3-4d3e-b33e-672b55f1d93a service placement] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:08.432341 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1325/2642] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:44:08.457959 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1318/2643] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:08 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:44:08.467683 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab41899-70c3-4d3e-b33e-672b55f1d93a service placement] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:08.469677 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8ab41899-70c3-4d3e-b33e-672b55f1d93a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:08.528338 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab41899-70c3-4d3e-b33e-672b55f1d93a service placement] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:08.533131 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3e7f8-bef6-4bf8-a0d2-0f8e567b64ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:08.533856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e7f8-bef6-4bf8-a0d2-0f8e567b64ab service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:08.534564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e7f8-bef6-4bf8-a0d2-0f8e567b64ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:08.534564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e7f8-bef6-4bf8-a0d2-0f8e567b64ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:08.544563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3e7f8-bef6-4bf8-a0d2-0f8e567b64ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:08.546167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3e7f8-bef6-4bf8-a0d2-0f8e567b64ab service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:08.560350 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1326/2644] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:08 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:08.701154 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ae64-fe0a-4ee9-a12e-0e56fd7297be None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:08.711592 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ae64-fe0a-4ee9-a12e-0e56fd7297be None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:08.715353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fc0bd-843e-481f-959a-656680add2e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:08.716087 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fc0bd-843e-481f-959a-656680add2e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:08.716370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fc0bd-843e-481f-959a-656680add2e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:08.716686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fc0bd-843e-481f-959a-656680add2e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:08.774527 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fc0bd-843e-481f-959a-656680add2e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:08.776024 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fc0bd-843e-481f-959a-656680add2e3 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:08.784975 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1319/2645] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:08 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:09.893405 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f9dea-371e-44c2-af03-c90afda06efd None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:09.893856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f9dea-371e-44c2-af03-c90afda06efd None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:09.893946 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f9dea-371e-44c2-af03-c90afda06efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:09.911740 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-3d7f9dea-371e-44c2-af03-c90afda06efd None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:09.912919 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-3d7f9dea-371e-44c2-af03-c90afda06efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:09.965146 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1327/2646] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:44:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:09.977467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fc0bd-843e-481f-959a-656680add2e3 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:09.978862 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-bc1fc0bd-843e-481f-959a-656680add2e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:10.045713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fc0bd-843e-481f-959a-656680add2e3 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:10.050711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feef574-c0d2-41d6-93fd-5c29a896365f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:10.051480 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef574-c0d2-41d6-93fd-5c29a896365f service swift] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:10.051769 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef574-c0d2-41d6-93fd-5c29a896365f service swift] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:10.052043 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef574-c0d2-41d6-93fd-5c29a896365f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:10.060589 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feef574-c0d2-41d6-93fd-5c29a896365f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:10.062224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feef574-c0d2-41d6-93fd-5c29a896365f service swift] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:10.070963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1320/2647] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:44:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:44:16.162140 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f9dea-371e-44c2-af03-c90afda06efd None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:16.228598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f9dea-371e-44c2-af03-c90afda06efd None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:16.233161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:16.234103 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:16.234417 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:16.234698 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] PATH_INFO: `/v3/users/46a0f0d383be4c5794d34ec3c0e7c996` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:16.236091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a0f0d383be4c5794d34ec3c0e7c996)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:16.238108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:16.288563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a0f0d383be4c5794d34ec3c0e7c996'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:16.297484 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a0f0d383be4c5794d34ec3c0e7c996'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:16.309863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a0f0d383be4c5794d34ec3c0e7c996'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:16.315020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a0f0d383be4c5794d34ec3c0e7c996'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:16.322635 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a0f0d383be4c5794d34ec3c0e7c996'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:16.334027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1328/2648] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:44:16 2022] DELETE /identity/v3/users/46a0f0d383be4c5794d34ec3c0e7c996 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:16.337129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b746f-1e51-410b-8b78-c31c60a035aa None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:16.337817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b746f-1e51-410b-8b78-c31c60a035aa None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:16.337817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b746f-1e51-410b-8b78-c31c60a035aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:16.513587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-461b746f-1e51-410b-8b78-c31c60a035aa None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:16.514713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-461b746f-1e51-410b-8b78-c31c60a035aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:16.577748 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1321/2649] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:16.587813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:16.589217 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:16.651198 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b4f61-c6e8-4118-89bf-cf9585973b30 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:16.654782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f34f6-01f8-4855-868c-46565698b9fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:16.655434 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f34f6-01f8-4855-868c-46565698b9fb service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:16.655712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f34f6-01f8-4855-868c-46565698b9fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:16.656008 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f34f6-01f8-4855-868c-46565698b9fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:16.665992 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f34f6-01f8-4855-868c-46565698b9fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:16.667829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f34f6-01f8-4855-868c-46565698b9fb service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:16.679435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1329/2650] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:17.044697 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b746f-1e51-410b-8b78-c31c60a035aa None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:17.046118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-461b746f-1e51-410b-8b78-c31c60a035aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:17.069194 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b746f-1e51-410b-8b78-c31c60a035aa None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:17.077297 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:17.078268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:17.078617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:17.078786 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] PATH_INFO: `/v3/projects/b10e0f6646164cd6a3c196c1cf71dc89` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:17.080028 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10e0f6646164cd6a3c196c1cf71dc89)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:17.081868 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:17.148638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10e0f6646164cd6a3c196c1cf71dc89', 'request_id': 'req-f230b725-3b52-49e4-976b-4686ef2a0ac1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.171502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10e0f6646164cd6a3c196c1cf71dc89', 'request_id': 'req-f230b725-3b52-49e4-976b-4686ef2a0ac1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.182445 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10e0f6646164cd6a3c196c1cf71dc89', 'request_id': 'req-f230b725-3b52-49e4-976b-4686ef2a0ac1'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.194853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] The token cache is being invalidate because project b10e0f6646164cd6a3c196c1cf71dc89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:44:17.195237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.195791 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.197661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1322/2651] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:44:17 2022] DELETE /identity/v3/projects/b10e0f6646164cd6a3c196c1cf71dc89 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:17.201374 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f34f6-01f8-4855-868c-46565698b9fb service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:17.212252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f34f6-01f8-4855-868c-46565698b9fb service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:17.274389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c79326-6bc0-4ca3-8cab-36e6712f0ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:17.275324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c79326-6bc0-4ca3-8cab-36e6712f0ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:17.275608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c79326-6bc0-4ca3-8cab-36e6712f0ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:17.275883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c79326-6bc0-4ca3-8cab-36e6712f0ec5 admin admin] PATH_INFO: `/v3/users/736d77bc76734e37980d1482719c71c2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:17.277162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c79326-6bc0-4ca3-8cab-36e6712f0ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=736d77bc76734e37980d1482719c71c2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:17.279186 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c79326-6bc0-4ca3-8cab-36e6712f0ec5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:17.350660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-37c79326-6bc0-4ca3-8cab-36e6712f0ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736d77bc76734e37980d1482719c71c2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.359777 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-37c79326-6bc0-4ca3-8cab-36e6712f0ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736d77bc76734e37980d1482719c71c2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.372966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-37c79326-6bc0-4ca3-8cab-36e6712f0ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736d77bc76734e37980d1482719c71c2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.373713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-37c79326-6bc0-4ca3-8cab-36e6712f0ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736d77bc76734e37980d1482719c71c2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.380412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-37c79326-6bc0-4ca3-8cab-36e6712f0ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736d77bc76734e37980d1482719c71c2'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.386938 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1330/2652] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:44:17 2022] DELETE /identity/v3/users/736d77bc76734e37980d1482719c71c2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:17.683555 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:17.685065 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:17.700532 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230b725-3b52-49e4-976b-4686ef2a0ac1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:17.757498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:17.758397 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:17.758680 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:17.758952 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7 admin admin] PATH_INFO: `/v3/projects/9216cc88e05d4f92a0ccf4b4da6a397d` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:17.760121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9216cc88e05d4f92a0ccf4b4da6a397d)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:17.762132 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:17.812831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9216cc88e05d4f92a0ccf4b4da6a397d', 'request_id': 'req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.818704 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9216cc88e05d4f92a0ccf4b4da6a397d', 'request_id': 'req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.826242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9216cc88e05d4f92a0ccf4b4da6a397d', 'request_id': 'req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.836357 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7 admin admin] The token cache is being invalidate because project 9216cc88e05d4f92a0ccf4b4da6a397d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:44:17.836646 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.837287 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ecd2c3a5-3cff-44a7-87b5-e01c0054eab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:17.838832 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1323/2653] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:44:17 2022] DELETE /identity/v3/projects/9216cc88e05d4f92a0ccf4b4da6a397d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:44:17.851320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a9427-954b-44f7-b498-fc3b64544d1a None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:17.851605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a9427-954b-44f7-b498-fc3b64544d1a None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:17.851882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a9427-954b-44f7-b498-fc3b64544d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:17.870381 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-7f1a9427-954b-44f7-b498-fc3b64544d1a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:17.871487 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-7f1a9427-954b-44f7-b498-fc3b64544d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:17.927561 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1331/2654] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:17.935272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b27d3-f315-4355-ac13-c26b89697143 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:17.935561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b27d3-f315-4355-ac13-c26b89697143 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:17.935838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b27d3-f315-4355-ac13-c26b89697143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:17.954497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-452b27d3-f315-4355-ac13-c26b89697143 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:17.955696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-452b27d3-f315-4355-ac13-c26b89697143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:17.963604 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1324/2655] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:17.967630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a9427-954b-44f7-b498-fc3b64544d1a None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:17.977737 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a9427-954b-44f7-b498-fc3b64544d1a None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:17.982252 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cd9c1-af68-429f-8b7a-3bd0e6a3c41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:17.982900 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd9c1-af68-429f-8b7a-3bd0e6a3c41e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:17.983181 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd9c1-af68-429f-8b7a-3bd0e6a3c41e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:17.983452 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd9c1-af68-429f-8b7a-3bd0e6a3c41e admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:17.984174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cd9c1-af68-429f-8b7a-3bd0e6a3c41e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:44:17.984477 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cd9c1-af68-429f-8b7a-3bd0e6a3c41e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:17.986063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cd9c1-af68-429f-8b7a-3bd0e6a3c41e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:17.998743 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1332/2656] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:44:18.003020 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b27d3-f315-4355-ac13-c26b89697143 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:18.012172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b27d3-f315-4355-ac13-c26b89697143 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:18.017504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e395f-4e63-46b2-b5f7-09c1d7da92d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:18.018161 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e395f-4e63-46b2-b5f7-09c1d7da92d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.018476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e395f-4e63-46b2-b5f7-09c1d7da92d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.018835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e395f-4e63-46b2-b5f7-09c1d7da92d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.019533 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e395f-4e63-46b2-b5f7-09c1d7da92d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:18.021618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e395f-4e63-46b2-b5f7-09c1d7da92d4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:18.050040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1325/2657] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:44:18 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:44:18.054247 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cd9c1-af68-429f-8b7a-3bd0e6a3c41e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:18.064226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cd9c1-af68-429f-8b7a-3bd0e6a3c41e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:18.131393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad940d32-f7cc-4f86-9f27-7a6c3a816cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:18.131980 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad940d32-f7cc-4f86-9f27-7a6c3a816cfb admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.132296 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad940d32-f7cc-4f86-9f27-7a6c3a816cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.132528 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad940d32-f7cc-4f86-9f27-7a6c3a816cfb admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.133229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad940d32-f7cc-4f86-9f27-7a6c3a816cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:18.135186 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad940d32-f7cc-4f86-9f27-7a6c3a816cfb admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:18.161786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1333/2658] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:44:18 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:44:18.162957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e395f-4e63-46b2-b5f7-09c1d7da92d4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:18.172956 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e395f-4e63-46b2-b5f7-09c1d7da92d4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:18.177568 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6781-9b08-4151-86a6-772945904d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:18.178248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6781-9b08-4151-86a6-772945904d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.178536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6781-9b08-4151-86a6-772945904d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.178810 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6781-9b08-4151-86a6-772945904d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.179593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed6781-9b08-4151-86a6-772945904d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:18.181334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed6781-9b08-4151-86a6-772945904d9c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:18.191851 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1326/2659] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:18.195827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad940d32-f7cc-4f86-9f27-7a6c3a816cfb admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:18.206247 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad940d32-f7cc-4f86-9f27-7a6c3a816cfb admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:18.211007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1010f8-ce03-4d2a-835c-742d2d3cd26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:18.211672 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1010f8-ce03-4d2a-835c-742d2d3cd26a admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.211951 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1010f8-ce03-4d2a-835c-742d2d3cd26a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.212225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1010f8-ce03-4d2a-835c-742d2d3cd26a admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.212954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1010f8-ce03-4d2a-835c-742d2d3cd26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:18.214610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1010f8-ce03-4d2a-835c-742d2d3cd26a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:18.225444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1334/2660] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:18.229437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6781-9b08-4151-86a6-772945904d9c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:18.239008 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6781-9b08-4151-86a6-772945904d9c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:18.243979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8664b4-40f6-4246-bf4a-c0aeeca7170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:18.244854 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8664b4-40f6-4246-bf4a-c0aeeca7170f admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.245133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8664b4-40f6-4246-bf4a-c0aeeca7170f admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.245444 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8664b4-40f6-4246-bf4a-c0aeeca7170f admin admin] PATH_INFO: `/v3/projects/090b332db0e447efaaa370d8f57ea49b/users/e9cc20cfac6a49b9a6352d69e76b0559/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.261123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8664b4-40f6-4246-bf4a-c0aeeca7170f admin admin] RBAC: Authorizing `identity:create_grant(project_id=090b332db0e447efaaa370d8f57ea49b, user_id=e9cc20cfac6a49b9a6352d69e76b0559, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:18.263805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8664b4-40f6-4246-bf4a-c0aeeca7170f admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:18.277876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1327/2661] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:44:18 2022] PUT /identity/v3/projects/090b332db0e447efaaa370d8f57ea49b/users/e9cc20cfac6a49b9a6352d69e76b0559/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:44:18.289220 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6615eb-39d1-434d-a2bc-26f80e9c5ef6 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.289512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6615eb-39d1-434d-a2bc-26f80e9c5ef6 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.289790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6615eb-39d1-434d-a2bc-26f80e9c5ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.316551 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-9e6615eb-39d1-434d-a2bc-26f80e9c5ef6 None None] MFA Rules not processed for user `e9cc20cfac6a49b9a6352d69e76b0559`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:18.317774 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9e6615eb-39d1-434d-a2bc-26f80e9c5ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:18.384330 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1335/2662] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:18.388663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8664b4-40f6-4246-bf4a-c0aeeca7170f admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:18.447696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8664b4-40f6-4246-bf4a-c0aeeca7170f admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:18.452321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a30b2d-eee6-4700-8a80-d1d7bf5208a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:18.453521 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a30b2d-eee6-4700-8a80-d1d7bf5208a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.453797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a30b2d-eee6-4700-8a80-d1d7bf5208a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.454063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a30b2d-eee6-4700-8a80-d1d7bf5208a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.454795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a30b2d-eee6-4700-8a80-d1d7bf5208a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:18.456676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a30b2d-eee6-4700-8a80-d1d7bf5208a1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:18.483892 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1328/2663] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:44:18 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:44:18.485021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6615eb-39d1-434d-a2bc-26f80e9c5ef6 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:18.496100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6615eb-39d1-434d-a2bc-26f80e9c5ef6 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:18.550639 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947b2d-d5b4-48ed-b849-e58703078531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:18.551310 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947b2d-d5b4-48ed-b849-e58703078531 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.551597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947b2d-d5b4-48ed-b849-e58703078531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.551869 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947b2d-d5b4-48ed-b849-e58703078531 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.552563 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86947b2d-d5b4-48ed-b849-e58703078531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:18.554512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86947b2d-d5b4-48ed-b849-e58703078531 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:18.574693 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1336/2664] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:44:18 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:44:18.579290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a30b2d-eee6-4700-8a80-d1d7bf5208a1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:18.588936 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a30b2d-eee6-4700-8a80-d1d7bf5208a1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:18.593471 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aaf96-f9d7-4840-9eed-f1ece064a2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:18.594172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aaf96-f9d7-4840-9eed-f1ece064a2cd admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.594481 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aaf96-f9d7-4840-9eed-f1ece064a2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.594760 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aaf96-f9d7-4840-9eed-f1ece064a2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.595480 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aaf96-f9d7-4840-9eed-f1ece064a2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:18.597057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aaf96-f9d7-4840-9eed-f1ece064a2cd admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:18.607383 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1329/2665] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:18.611844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947b2d-d5b4-48ed-b849-e58703078531 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:18.622057 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947b2d-d5b4-48ed-b849-e58703078531 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:18.627306 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c6676-97ef-4b35-94b7-34a7a6dd2a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:18.627969 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c6676-97ef-4b35-94b7-34a7a6dd2a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.628254 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c6676-97ef-4b35-94b7-34a7a6dd2a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.628531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c6676-97ef-4b35-94b7-34a7a6dd2a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.629258 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c6676-97ef-4b35-94b7-34a7a6dd2a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:18.630969 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c6676-97ef-4b35-94b7-34a7a6dd2a1d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:18.641320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1337/2666] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:18.645158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aaf96-f9d7-4840-9eed-f1ece064a2cd admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:18.654869 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aaf96-f9d7-4840-9eed-f1ece064a2cd admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:18.659998 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feca68-f2bd-4707-a007-e51aa7cbb2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:18.661023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feca68-f2bd-4707-a007-e51aa7cbb2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.661304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feca68-f2bd-4707-a007-e51aa7cbb2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.661572 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feca68-f2bd-4707-a007-e51aa7cbb2c8 admin admin] PATH_INFO: `/v3/projects/a3d35744809d41a5a6835de3d66ef84c/users/1f38be6ad1a749bfbcf4aeb126440550/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.676158 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47feca68-f2bd-4707-a007-e51aa7cbb2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d35744809d41a5a6835de3d66ef84c, user_id=1f38be6ad1a749bfbcf4aeb126440550, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:18.678836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47feca68-f2bd-4707-a007-e51aa7cbb2c8 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:18.692545 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1330/2667] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:44:18 2022] PUT /identity/v3/projects/a3d35744809d41a5a6835de3d66ef84c/users/1f38be6ad1a749bfbcf4aeb126440550/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:18.702691 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14537c-c697-4577-a116-6383bd94caa1 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.703061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14537c-c697-4577-a116-6383bd94caa1 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.703411 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14537c-c697-4577-a116-6383bd94caa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.732235 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-5a14537c-c697-4577-a116-6383bd94caa1 None None] MFA Rules not processed for user `1f38be6ad1a749bfbcf4aeb126440550`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:18.733456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5a14537c-c697-4577-a116-6383bd94caa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:18.798647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1338/2668] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:18.803213 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feca68-f2bd-4707-a007-e51aa7cbb2c8 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:18.861336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feca68-f2bd-4707-a007-e51aa7cbb2c8 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:18.866107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c2ab4-d203-4f84-8ff1-0c98809f6659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:18.866795 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c2ab4-d203-4f84-8ff1-0c98809f6659 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.867056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c2ab4-d203-4f84-8ff1-0c98809f6659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.867325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c2ab4-d203-4f84-8ff1-0c98809f6659 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.868003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c2ab4-d203-4f84-8ff1-0c98809f6659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:18.869863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c2ab4-d203-4f84-8ff1-0c98809f6659 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:18.894676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1331/2669] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:44:18 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:44:18.898766 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14537c-c697-4577-a116-6383bd94caa1 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:18.909080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14537c-c697-4577-a116-6383bd94caa1 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:18.961328 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873b9a9-45e1-4fb9-9d12-0b097e392929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:18.961975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873b9a9-45e1-4fb9-9d12-0b097e392929 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:18.962280 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873b9a9-45e1-4fb9-9d12-0b097e392929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:18.962555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873b9a9-45e1-4fb9-9d12-0b097e392929 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:18.963237 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873b9a9-45e1-4fb9-9d12-0b097e392929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:18.965438 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873b9a9-45e1-4fb9-9d12-0b097e392929 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:18.984676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1339/2670] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:44:18 2022] POST /identity/v3/users => generated 295 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:44:18.989517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c2ab4-d203-4f84-8ff1-0c98809f6659 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:19.001118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c2ab4-d203-4f84-8ff1-0c98809f6659 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:19.005683 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d948e-7ab0-4f92-a8b9-7e3bd321547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:19.006441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d948e-7ab0-4f92-a8b9-7e3bd321547b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:19.006786 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d948e-7ab0-4f92-a8b9-7e3bd321547b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:19.007118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d948e-7ab0-4f92-a8b9-7e3bd321547b admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:19.007903 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d948e-7ab0-4f92-a8b9-7e3bd321547b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:19.010359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d948e-7ab0-4f92-a8b9-7e3bd321547b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:19.020963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1332/2671] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:19.025106 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873b9a9-45e1-4fb9-9d12-0b097e392929 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:19.035244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873b9a9-45e1-4fb9-9d12-0b097e392929 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:19.039782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbe2d7-abf9-4288-8894-1a63f3784ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:19.040648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbe2d7-abf9-4288-8894-1a63f3784ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:19.040927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbe2d7-abf9-4288-8894-1a63f3784ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:19.041197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbe2d7-abf9-4288-8894-1a63f3784ac9 admin admin] PATH_INFO: `/v3/projects/4a3c93524e8b48529b984269967388bf/users/f3f4af1311ca49d9aa244d10aaa9cd35/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:19.056241 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbe2d7-abf9-4288-8894-1a63f3784ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3c93524e8b48529b984269967388bf, user_id=f3f4af1311ca49d9aa244d10aaa9cd35, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:19.058998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbe2d7-abf9-4288-8894-1a63f3784ac9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:19.072700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1340/2672] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:44:19 2022] PUT /identity/v3/projects/4a3c93524e8b48529b984269967388bf/users/f3f4af1311ca49d9aa244d10aaa9cd35/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:19.076519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d948e-7ab0-4f92-a8b9-7e3bd321547b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:19.086496 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d948e-7ab0-4f92-a8b9-7e3bd321547b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:19.141097 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f1f74-5959-4fdb-8c0c-6cfcd592c616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:19.141762 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f1f74-5959-4fdb-8c0c-6cfcd592c616 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:19.142040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f1f74-5959-4fdb-8c0c-6cfcd592c616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:19.142349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f1f74-5959-4fdb-8c0c-6cfcd592c616 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:19.143061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f1f74-5959-4fdb-8c0c-6cfcd592c616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:19.144666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f1f74-5959-4fdb-8c0c-6cfcd592c616 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:19.153902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1333/2673] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:19.158641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbe2d7-abf9-4288-8894-1a63f3784ac9 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:19.168935 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbe2d7-abf9-4288-8894-1a63f3784ac9 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:19.174145 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbfbb1-ab59-4e87-8207-d5a1dddb31e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:19.175041 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbfbb1-ab59-4e87-8207-d5a1dddb31e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:19.175324 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbfbb1-ab59-4e87-8207-d5a1dddb31e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:19.175593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbfbb1-ab59-4e87-8207-d5a1dddb31e0 admin admin] PATH_INFO: `/v3/projects/4a3c93524e8b48529b984269967388bf/users/f3f4af1311ca49d9aa244d10aaa9cd35/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:19.177612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbfbb1-ab59-4e87-8207-d5a1dddb31e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3c93524e8b48529b984269967388bf, user_id=f3f4af1311ca49d9aa244d10aaa9cd35, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:19.180255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbfbb1-ab59-4e87-8207-d5a1dddb31e0 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:19.190830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1341/2674] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:44:19 2022] PUT /identity/v3/projects/4a3c93524e8b48529b984269967388bf/users/f3f4af1311ca49d9aa244d10aaa9cd35/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:44:19.200850 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83cc4-56d2-4a41-9e07-2cf68bca860a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:19.201218 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83cc4-56d2-4a41-9e07-2cf68bca860a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:19.201494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83cc4-56d2-4a41-9e07-2cf68bca860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:19.227404 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-6ab83cc4-56d2-4a41-9e07-2cf68bca860a None None] MFA Rules not processed for user `f3f4af1311ca49d9aa244d10aaa9cd35`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:19.228624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6ab83cc4-56d2-4a41-9e07-2cf68bca860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:19.300793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1334/2675] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:44:19.311106 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbfbb1-ab59-4e87-8207-d5a1dddb31e0 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:19.312734 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a1cbfbb1-ab59-4e87-8207-d5a1dddb31e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:19.373650 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbfbb1-ab59-4e87-8207-d5a1dddb31e0 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:19.377671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1722d-c5d2-47b6-b13e-24cd0cbc204e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:19.378323 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1722d-c5d2-47b6-b13e-24cd0cbc204e service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:19.378610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1722d-c5d2-47b6-b13e-24cd0cbc204e service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:19.378892 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1722d-c5d2-47b6-b13e-24cd0cbc204e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:19.388084 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1722d-c5d2-47b6-b13e-24cd0cbc204e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:19.389740 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1722d-c5d2-47b6-b13e-24cd0cbc204e service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:19.399783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1342/2676] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:19.443256 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab83cc4-56d2-4a41-9e07-2cf68bca860a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:19.444768 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6ab83cc4-56d2-4a41-9e07-2cf68bca860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:19.456931 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab83cc4-56d2-4a41-9e07-2cf68bca860a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:19.460545 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c2e34-63e5-449e-afa6-e547860dac65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:19.461178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c2e34-63e5-449e-afa6-e547860dac65 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:19.461456 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c2e34-63e5-449e-afa6-e547860dac65 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:19.461750 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c2e34-63e5-449e-afa6-e547860dac65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:19.518441 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c2e34-63e5-449e-afa6-e547860dac65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:19.519991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c2e34-63e5-449e-afa6-e547860dac65 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:19.529038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1335/2677] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:22.334007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1722d-c5d2-47b6-b13e-24cd0cbc204e service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:22.408889 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1722d-c5d2-47b6-b13e-24cd0cbc204e service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:22.414804 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:22.416291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:22.416577 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:22.416854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] PATH_INFO: `/v3/users/e9cc20cfac6a49b9a6352d69e76b0559` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:22.418462 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9cc20cfac6a49b9a6352d69e76b0559)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:22.420390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:22.529978 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9cc20cfac6a49b9a6352d69e76b0559'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:22.543364 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9cc20cfac6a49b9a6352d69e76b0559'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:22.557816 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9cc20cfac6a49b9a6352d69e76b0559'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:22.558851 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9cc20cfac6a49b9a6352d69e76b0559'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:22.569751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9cc20cfac6a49b9a6352d69e76b0559'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:22.576460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1343/2678] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:44:22 2022] DELETE /identity/v3/users/e9cc20cfac6a49b9a6352d69e76b0559 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:22.581347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b4738-8065-425b-99b7-acb80b65d473 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:22.582018 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b4738-8065-425b-99b7-acb80b65d473 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:22.582018 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b4738-8065-425b-99b7-acb80b65d473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:22.605662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-652b4738-8065-425b-99b7-acb80b65d473 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:22.607725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-652b4738-8065-425b-99b7-acb80b65d473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:22.687677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1336/2679] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:44:22.698359 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:22.700251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:22.768369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe11b74-4300-4a60-b243-d5f1e9a3b09a admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:22.772253 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d781e8-e84e-4b51-9c24-b52acca4205b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:22.773143 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d781e8-e84e-4b51-9c24-b52acca4205b service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:22.773534 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d781e8-e84e-4b51-9c24-b52acca4205b service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:22.773818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d781e8-e84e-4b51-9c24-b52acca4205b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:22.784069 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d781e8-e84e-4b51-9c24-b52acca4205b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:22.785530 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d781e8-e84e-4b51-9c24-b52acca4205b service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:22.795707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1344/2680] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:22.919023 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1afc3-a46f-48ad-82ba-d0c3fae35098 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:22.919308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1afc3-a46f-48ad-82ba-d0c3fae35098 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:22.919586 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1afc3-a46f-48ad-82ba-d0c3fae35098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:22.939754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-a0d1afc3-a46f-48ad-82ba-d0c3fae35098 None None] MFA Rules not processed for user `d40b20a8c16d4771b4410f975e9f2a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:22.941059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-a0d1afc3-a46f-48ad-82ba-d0c3fae35098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:23.029331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1337/2681] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:23.138735 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d781e8-e84e-4b51-9c24-b52acca4205b service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:23.141113 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-09d781e8-e84e-4b51-9c24-b52acca4205b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:23.159547 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d781e8-e84e-4b51-9c24-b52acca4205b service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:23.167399 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:23.168322 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:23.168610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:23.168933 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] PATH_INFO: `/v3/projects/090b332db0e447efaaa370d8f57ea49b` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:23.170174 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=090b332db0e447efaaa370d8f57ea49b)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:23.172760 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:23.229952 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090b332db0e447efaaa370d8f57ea49b', 'request_id': 'req-90a4768b-7e78-480f-bbca-a18364214f66'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.236541 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090b332db0e447efaaa370d8f57ea49b', 'request_id': 'req-90a4768b-7e78-480f-bbca-a18364214f66'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.246044 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090b332db0e447efaaa370d8f57ea49b', 'request_id': 'req-90a4768b-7e78-480f-bbca-a18364214f66'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.260901 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] The token cache is being invalidate because project 090b332db0e447efaaa370d8f57ea49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:44:23.261256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.261924 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.263648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1345/2682] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:44:23 2022] DELETE /identity/v3/projects/090b332db0e447efaaa370d8f57ea49b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:23.267873 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1afc3-a46f-48ad-82ba-d0c3fae35098 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:23.278015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1afc3-a46f-48ad-82ba-d0c3fae35098 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:23.331093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:23.332019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:23.332301 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:23.332576 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] PATH_INFO: `/v3/users/1f38be6ad1a749bfbcf4aeb126440550` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:23.333749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f38be6ad1a749bfbcf4aeb126440550)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:23.335733 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:23.376044 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:23.377447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:23.381248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f38be6ad1a749bfbcf4aeb126440550'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.387806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f38be6ad1a749bfbcf4aeb126440550'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.399137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f38be6ad1a749bfbcf4aeb126440550'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.399961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f38be6ad1a749bfbcf4aeb126440550'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.400631 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f38be6ad1a749bfbcf4aeb126440550'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.413745 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1338/2683] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:44:23 2022] DELETE /identity/v3/users/1f38be6ad1a749bfbcf4aeb126440550 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:23.435086 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4768b-7e78-480f-bbca-a18364214f66 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:23.485250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfece91-8b2b-4adb-a66f-9c82dfd8d3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:23.486139 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfece91-8b2b-4adb-a66f-9c82dfd8d3fd service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:23.486488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfece91-8b2b-4adb-a66f-9c82dfd8d3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:23.486768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfece91-8b2b-4adb-a66f-9c82dfd8d3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:23.489357 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6dfece91-8b2b-4adb-a66f-9c82dfd8d3fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:23.499464 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfece91-8b2b-4adb-a66f-9c82dfd8d3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:23.500948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfece91-8b2b-4adb-a66f-9c82dfd8d3fd service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:23.509609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1346/2684] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:44:23.759324 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:23.760770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:23.832446 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85401332-6a83-4ba4-bacd-382c3dc38dfd admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:23.838437 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:23.839502 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:23.839963 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:23.840396 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] PATH_INFO: `/v3/projects/a3d35744809d41a5a6835de3d66ef84c` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:23.842045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d35744809d41a5a6835de3d66ef84c)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:23.844683 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:23.910669 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d35744809d41a5a6835de3d66ef84c', 'request_id': 'req-52678152-db25-4bc1-b210-4f55e0202530'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.924094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d35744809d41a5a6835de3d66ef84c', 'request_id': 'req-52678152-db25-4bc1-b210-4f55e0202530'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.936223 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d35744809d41a5a6835de3d66ef84c', 'request_id': 'req-52678152-db25-4bc1-b210-4f55e0202530'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.949907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] The token cache is being invalidate because project a3d35744809d41a5a6835de3d66ef84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:44:23.950540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.951274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:23.953500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1339/2685] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:44:23 2022] DELETE /identity/v3/projects/a3d35744809d41a5a6835de3d66ef84c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:23.958129 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfece91-8b2b-4adb-a66f-9c82dfd8d3fd service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:23.982095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfece91-8b2b-4adb-a66f-9c82dfd8d3fd service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:24.055063 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dfdeb-7b0e-4446-b5d6-39ebfd7d4651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:24.056023 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dfdeb-7b0e-4446-b5d6-39ebfd7d4651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:24.056416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dfdeb-7b0e-4446-b5d6-39ebfd7d4651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:24.056774 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dfdeb-7b0e-4446-b5d6-39ebfd7d4651 admin admin] PATH_INFO: `/v3/users/f3f4af1311ca49d9aa244d10aaa9cd35` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:24.057983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dfdeb-7b0e-4446-b5d6-39ebfd7d4651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f4af1311ca49d9aa244d10aaa9cd35)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:24.059942 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dfdeb-7b0e-4446-b5d6-39ebfd7d4651 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:24.113789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-7e4dfdeb-7b0e-4446-b5d6-39ebfd7d4651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f4af1311ca49d9aa244d10aaa9cd35'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.122780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-7e4dfdeb-7b0e-4446-b5d6-39ebfd7d4651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f4af1311ca49d9aa244d10aaa9cd35'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.135573 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-7e4dfdeb-7b0e-4446-b5d6-39ebfd7d4651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f4af1311ca49d9aa244d10aaa9cd35'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.136413 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-7e4dfdeb-7b0e-4446-b5d6-39ebfd7d4651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f4af1311ca49d9aa244d10aaa9cd35'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.144171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-7e4dfdeb-7b0e-4446-b5d6-39ebfd7d4651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f4af1311ca49d9aa244d10aaa9cd35'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.150805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1347/2686] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:44:23 2022] DELETE /identity/v3/users/f3f4af1311ca49d9aa244d10aaa9cd35 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:24.427736 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:24.429251 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:24.442801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52678152-db25-4bc1-b210-4f55e0202530 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:24.502014 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:24.502891 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:24.503178 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:24.503448 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0 admin admin] PATH_INFO: `/v3/projects/4a3c93524e8b48529b984269967388bf` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:24.504611 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a3c93524e8b48529b984269967388bf)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:24.506530 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:24.549091 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a3c93524e8b48529b984269967388bf', 'request_id': 'req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.554857 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a3c93524e8b48529b984269967388bf', 'request_id': 'req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.561521 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a3c93524e8b48529b984269967388bf', 'request_id': 'req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.572104 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0 admin admin] The token cache is being invalidate because project 4a3c93524e8b48529b984269967388bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:44:24.572390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.573010 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d25bc28a-e4ba-4dbd-9d87-06e7c28399e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.574530 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1340/2687] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:44:24 2022] DELETE /identity/v3/projects/4a3c93524e8b48529b984269967388bf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:24.581163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658bff9-8ca5-4009-915d-6fcd6868f259 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:24.581641 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658bff9-8ca5-4009-915d-6fcd6868f259 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:24.581739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658bff9-8ca5-4009-915d-6fcd6868f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:24.598671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-6658bff9-8ca5-4009-915d-6fcd6868f259 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:24.599868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-6658bff9-8ca5-4009-915d-6fcd6868f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:24.656445 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1348/2688] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:24.666107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815946d-83ab-4a22-bfda-c776c371bbb0 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:24.666430 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815946d-83ab-4a22-bfda-c776c371bbb0 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:24.666712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815946d-83ab-4a22-bfda-c776c371bbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:24.685520 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f815946d-83ab-4a22-bfda-c776c371bbb0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:24.687392 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f815946d-83ab-4a22-bfda-c776c371bbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:24.695347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1341/2689] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:24.699516 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658bff9-8ca5-4009-915d-6fcd6868f259 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:24.709118 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658bff9-8ca5-4009-915d-6fcd6868f259 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:24.713723 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152ac1-3939-430b-a4e5-a0ef8dc5ae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:24.714398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152ac1-3939-430b-a4e5-a0ef8dc5ae30 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:24.714684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152ac1-3939-430b-a4e5-a0ef8dc5ae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:24.714964 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152ac1-3939-430b-a4e5-a0ef8dc5ae30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:24.715685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152ac1-3939-430b-a4e5-a0ef8dc5ae30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:44:24.715996 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152ac1-3939-430b-a4e5-a0ef8dc5ae30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:24.717604 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152ac1-3939-430b-a4e5-a0ef8dc5ae30 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:24.728891 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1349/2690] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:44:24.733103 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815946d-83ab-4a22-bfda-c776c371bbb0 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:24.742738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815946d-83ab-4a22-bfda-c776c371bbb0 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:24.747320 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5db23-f0dc-4524-a7cc-eeef93249ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:24.747966 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5db23-f0dc-4524-a7cc-eeef93249ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:24.748240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5db23-f0dc-4524-a7cc-eeef93249ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:24.748517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5db23-f0dc-4524-a7cc-eeef93249ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:24.749784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5db23-f0dc-4524-a7cc-eeef93249ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:24.751715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5db23-f0dc-4524-a7cc-eeef93249ca4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:24.785990 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1342/2691] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:44:24 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:44:24.790087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152ac1-3939-430b-a4e5-a0ef8dc5ae30 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:24.799786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152ac1-3939-430b-a4e5-a0ef8dc5ae30 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:24.853908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75f1f3-9fdb-4dc5-bb21-03418ea18128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:24.854623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f1f3-9fdb-4dc5-bb21-03418ea18128 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:24.854902 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f1f3-9fdb-4dc5-bb21-03418ea18128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:24.855172 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f1f3-9fdb-4dc5-bb21-03418ea18128 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:24.855871 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75f1f3-9fdb-4dc5-bb21-03418ea18128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:24.857756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75f1f3-9fdb-4dc5-bb21-03418ea18128 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:24.876832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1350/2692] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:44:24 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:44:24.880872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5db23-f0dc-4524-a7cc-eeef93249ca4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:24.891306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5db23-f0dc-4524-a7cc-eeef93249ca4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:24.896069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0d3c6-e3dd-4d1f-b98a-087b3a7a591a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:24.896724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d3c6-e3dd-4d1f-b98a-087b3a7a591a admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:24.897022 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d3c6-e3dd-4d1f-b98a-087b3a7a591a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:24.897285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d3c6-e3dd-4d1f-b98a-087b3a7a591a admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:24.898009 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0d3c6-e3dd-4d1f-b98a-087b3a7a591a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:24.899663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0d3c6-e3dd-4d1f-b98a-087b3a7a591a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:24.909879 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1343/2693] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:24.913571 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75f1f3-9fdb-4dc5-bb21-03418ea18128 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:24.923317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75f1f3-9fdb-4dc5-bb21-03418ea18128 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:24.927915 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6610a26-64e3-4759-bc80-0dc4e2ff1328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:24.928552 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6610a26-64e3-4759-bc80-0dc4e2ff1328 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:24.928834 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6610a26-64e3-4759-bc80-0dc4e2ff1328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:24.929108 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6610a26-64e3-4759-bc80-0dc4e2ff1328 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:24.929854 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6610a26-64e3-4759-bc80-0dc4e2ff1328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:24.931481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6610a26-64e3-4759-bc80-0dc4e2ff1328 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:24.941161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1351/2694] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:24.944921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0d3c6-e3dd-4d1f-b98a-087b3a7a591a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:24.955046 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0d3c6-e3dd-4d1f-b98a-087b3a7a591a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:24.959805 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ddeb5-9667-45b0-aa36-c9d9dd1756c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:24.960697 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ddeb5-9667-45b0-aa36-c9d9dd1756c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:24.960982 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ddeb5-9667-45b0-aa36-c9d9dd1756c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:24.961255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ddeb5-9667-45b0-aa36-c9d9dd1756c5 admin admin] PATH_INFO: `/v3/projects/500b0e8846a4450f8a258906018073b4/users/585a383a382c41319b9ffc7722fcb061/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:24.976089 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ddeb5-9667-45b0-aa36-c9d9dd1756c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=500b0e8846a4450f8a258906018073b4, user_id=585a383a382c41319b9ffc7722fcb061, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:24.978726 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ddeb5-9667-45b0-aa36-c9d9dd1756c5 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:24.991562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1344/2695] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:44:24 2022] PUT /identity/v3/projects/500b0e8846a4450f8a258906018073b4/users/585a383a382c41319b9ffc7722fcb061/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:25.003232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb96e4-0cf9-4046-91f6-a5010e157014 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.003517 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb96e4-0cf9-4046-91f6-a5010e157014 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.003788 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb96e4-0cf9-4046-91f6-a5010e157014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.030849 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-5bdb96e4-0cf9-4046-91f6-a5010e157014 None None] MFA Rules not processed for user `585a383a382c41319b9ffc7722fcb061`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:25.032032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-5bdb96e4-0cf9-4046-91f6-a5010e157014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:25.135424 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1352/2696] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:25.146275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ddeb5-9667-45b0-aa36-c9d9dd1756c5 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:25.148344 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ad1ddeb5-9667-45b0-aa36-c9d9dd1756c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:25.219315 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ddeb5-9667-45b0-aa36-c9d9dd1756c5 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:25.223215 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e3589-5c75-48a7-918d-3bee11a7b7b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:25.223864 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e3589-5c75-48a7-918d-3bee11a7b7b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.224144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e3589-5c75-48a7-918d-3bee11a7b7b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.224417 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e3589-5c75-48a7-918d-3bee11a7b7b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.233416 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e3589-5c75-48a7-918d-3bee11a7b7b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:25.235057 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e3589-5c75-48a7-918d-3bee11a7b7b8 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:25.244221 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1345/2697] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:25.341579 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac2167-8e9f-4114-a609-b240d1ae5eff None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.342106 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac2167-8e9f-4114-a609-b240d1ae5eff None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.342575 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac2167-8e9f-4114-a609-b240d1ae5eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.367284 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-2eac2167-8e9f-4114-a609-b240d1ae5eff None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:25.368850 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-2eac2167-8e9f-4114-a609-b240d1ae5eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:25.440955 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1353/2698] 10.222.0.79 () {58 vars in 967 bytes} [Mon Feb 21 01:44:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:25.459070 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e3589-5c75-48a7-918d-3bee11a7b7b8 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:25.460978 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e83e3589-5c75-48a7-918d-3bee11a7b7b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:25.578192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e3589-5c75-48a7-918d-3bee11a7b7b8 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:25.587511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6a32a-3001-4542-a08e-f05bff4e95b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:25.588223 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a32a-3001-4542-a08e-f05bff4e95b4 service swift] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.588746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a32a-3001-4542-a08e-f05bff4e95b4 service swift] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.589021 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a32a-3001-4542-a08e-f05bff4e95b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.607227 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6a32a-3001-4542-a08e-f05bff4e95b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:25.608083 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6a32a-3001-4542-a08e-f05bff4e95b4 service swift] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:25.617243 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1346/2699] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:44:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:44:42.794537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac2167-8e9f-4114-a609-b240d1ae5eff None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:42.857914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac2167-8e9f-4114-a609-b240d1ae5eff None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:42.862700 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:42.863568 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:42.864110 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:42.864381 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] PATH_INFO: `/v3/users/585a383a382c41319b9ffc7722fcb061` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:42.865598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] RBAC: Authorizing `identity:delete_user(user_id=585a383a382c41319b9ffc7722fcb061)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:42.867546 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:42.912585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585a383a382c41319b9ffc7722fcb061'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:42.919883 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585a383a382c41319b9ffc7722fcb061'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:42.931289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585a383a382c41319b9ffc7722fcb061'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:42.931914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585a383a382c41319b9ffc7722fcb061'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:42.938671 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585a383a382c41319b9ffc7722fcb061'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:42.944243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1354/2700] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:44:42 2022] DELETE /identity/v3/users/585a383a382c41319b9ffc7722fcb061 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:42.948843 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309650cc-6337-4391-8911-2b78eb04c0e8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:42.949302 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309650cc-6337-4391-8911-2b78eb04c0e8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:42.949420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309650cc-6337-4391-8911-2b78eb04c0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:42.967040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-309650cc-6337-4391-8911-2b78eb04c0e8 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:42.968876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-309650cc-6337-4391-8911-2b78eb04c0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:43.026234 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1347/2701] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:43.035748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:43.037128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:43.097433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06179b0-7555-4b5b-a55b-48f8a289370f admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:43.102644 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ac5d5-8332-4eb3-9cb8-d8c54ab782fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:43.103262 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ac5d5-8332-4eb3-9cb8-d8c54ab782fa service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:43.103554 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ac5d5-8332-4eb3-9cb8-d8c54ab782fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:43.103890 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ac5d5-8332-4eb3-9cb8-d8c54ab782fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:43.114095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ac5d5-8332-4eb3-9cb8-d8c54ab782fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:43.115621 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ac5d5-8332-4eb3-9cb8-d8c54ab782fa service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:43.125817 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1355/2702] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:43.406581 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309650cc-6337-4391-8911-2b78eb04c0e8 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:43.408210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-309650cc-6337-4391-8911-2b78eb04c0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:43.421137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309650cc-6337-4391-8911-2b78eb04c0e8 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:43.425589 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b723310-2414-4f39-9538-960a5d818a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:43.426595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b723310-2414-4f39-9538-960a5d818a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:43.426948 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b723310-2414-4f39-9538-960a5d818a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:43.427295 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b723310-2414-4f39-9538-960a5d818a3a admin admin] PATH_INFO: `/v3/projects/500b0e8846a4450f8a258906018073b4` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:43.428607 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b723310-2414-4f39-9538-960a5d818a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=500b0e8846a4450f8a258906018073b4)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:43.430703 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b723310-2414-4f39-9538-960a5d818a3a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:43.478307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4b723310-2414-4f39-9538-960a5d818a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500b0e8846a4450f8a258906018073b4', 'request_id': 'req-4b723310-2414-4f39-9538-960a5d818a3a'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:43.485244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4b723310-2414-4f39-9538-960a5d818a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500b0e8846a4450f8a258906018073b4', 'request_id': 'req-4b723310-2414-4f39-9538-960a5d818a3a'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:43.493732 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4b723310-2414-4f39-9538-960a5d818a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500b0e8846a4450f8a258906018073b4', 'request_id': 'req-4b723310-2414-4f39-9538-960a5d818a3a'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:43.504925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4b723310-2414-4f39-9538-960a5d818a3a admin admin] The token cache is being invalidate because project 500b0e8846a4450f8a258906018073b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:44:43.505213 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4b723310-2414-4f39-9538-960a5d818a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:43.505844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-4b723310-2414-4f39-9538-960a5d818a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:43.507387 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1348/2703] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:44:43 2022] DELETE /identity/v3/projects/500b0e8846a4450f8a258906018073b4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:43.513207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda6618-88aa-4bd0-b264-0fe27625cfdd None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:43.513495 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda6618-88aa-4bd0-b264-0fe27625cfdd None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:43.513770 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda6618-88aa-4bd0-b264-0fe27625cfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:43.530791 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-cdda6618-88aa-4bd0-b264-0fe27625cfdd None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:43.531954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-cdda6618-88aa-4bd0-b264-0fe27625cfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:43.588412 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1356/2704] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:43.596376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214eae3-9253-4931-89d5-1ae3cafdb714 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:43.596667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214eae3-9253-4931-89d5-1ae3cafdb714 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:43.596943 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214eae3-9253-4931-89d5-1ae3cafdb714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:43.616325 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e214eae3-9253-4931-89d5-1ae3cafdb714 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:43.617520 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e214eae3-9253-4931-89d5-1ae3cafdb714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:43.627487 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1349/2705] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:43.631701 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda6618-88aa-4bd0-b264-0fe27625cfdd None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:43.641267 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda6618-88aa-4bd0-b264-0fe27625cfdd None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:43.645792 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1b45c-8055-43e3-ae6e-98573bc80068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:43.646466 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1b45c-8055-43e3-ae6e-98573bc80068 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:43.646748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1b45c-8055-43e3-ae6e-98573bc80068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:43.647020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1b45c-8055-43e3-ae6e-98573bc80068 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:43.647738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1b45c-8055-43e3-ae6e-98573bc80068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:44:43.648044 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1b45c-8055-43e3-ae6e-98573bc80068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:43.649661 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1b45c-8055-43e3-ae6e-98573bc80068 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:43.661346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1357/2706] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:44:43.665569 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214eae3-9253-4931-89d5-1ae3cafdb714 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:43.675169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214eae3-9253-4931-89d5-1ae3cafdb714 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:43.679791 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d1ef-93e6-4722-8c54-68965f5dd457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:43.680434 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d1ef-93e6-4722-8c54-68965f5dd457 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:43.680717 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d1ef-93e6-4722-8c54-68965f5dd457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:43.680992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d1ef-93e6-4722-8c54-68965f5dd457 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:43.681676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59d1ef-93e6-4722-8c54-68965f5dd457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:43.683605 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59d1ef-93e6-4722-8c54-68965f5dd457 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:43.708013 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1350/2707] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:44:43 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:44:43.712067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1b45c-8055-43e3-ae6e-98573bc80068 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:43.722427 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1b45c-8055-43e3-ae6e-98573bc80068 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:43.775449 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cdba8-8dbd-4c06-81cd-46ecd71115e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:43.776033 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cdba8-8dbd-4c06-81cd-46ecd71115e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:43.776313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cdba8-8dbd-4c06-81cd-46ecd71115e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:43.776587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cdba8-8dbd-4c06-81cd-46ecd71115e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:43.777256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cdba8-8dbd-4c06-81cd-46ecd71115e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:43.779221 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cdba8-8dbd-4c06-81cd-46ecd71115e1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:43.803249 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1358/2708] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:44:43 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:44:43.804402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d1ef-93e6-4722-8c54-68965f5dd457 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:43.815624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d1ef-93e6-4722-8c54-68965f5dd457 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:43.820150 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb549d1-9ca8-4444-bc36-c6d514ca1b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:43.820796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb549d1-9ca8-4444-bc36-c6d514ca1b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:43.821075 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb549d1-9ca8-4444-bc36-c6d514ca1b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:43.821345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb549d1-9ca8-4444-bc36-c6d514ca1b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:43.822061 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb549d1-9ca8-4444-bc36-c6d514ca1b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:43.823677 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb549d1-9ca8-4444-bc36-c6d514ca1b46 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:43.834518 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1351/2709] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:43.838738 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cdba8-8dbd-4c06-81cd-46ecd71115e1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:43.849107 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cdba8-8dbd-4c06-81cd-46ecd71115e1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:43.854151 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a4642-5fb3-42f2-8a19-3e9a673f7224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:43.855052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a4642-5fb3-42f2-8a19-3e9a673f7224 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:43.855326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a4642-5fb3-42f2-8a19-3e9a673f7224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:43.855601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a4642-5fb3-42f2-8a19-3e9a673f7224 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:43.856333 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a4642-5fb3-42f2-8a19-3e9a673f7224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:43.858646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a4642-5fb3-42f2-8a19-3e9a673f7224 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:43.869046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1359/2710] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:43.873297 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb549d1-9ca8-4444-bc36-c6d514ca1b46 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:43.882932 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb549d1-9ca8-4444-bc36-c6d514ca1b46 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:43.887525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09d46e-c17d-42b6-8693-7574d45ab98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:43.888400 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09d46e-c17d-42b6-8693-7574d45ab98a admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:43.888681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09d46e-c17d-42b6-8693-7574d45ab98a admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:43.888954 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09d46e-c17d-42b6-8693-7574d45ab98a admin admin] PATH_INFO: `/v3/projects/b66e423d409949a1a7908400e6972e43/users/10109ab264f2468793f720ae838260d9/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:43.904259 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09d46e-c17d-42b6-8693-7574d45ab98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66e423d409949a1a7908400e6972e43, user_id=10109ab264f2468793f720ae838260d9, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:43.907420 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09d46e-c17d-42b6-8693-7574d45ab98a admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:43.921897 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1352/2711] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:44:43 2022] PUT /identity/v3/projects/b66e423d409949a1a7908400e6972e43/users/10109ab264f2468793f720ae838260d9/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:44:43.932518 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d65a5-86de-4984-a5bd-01a0aeb3a726 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:43.932813 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d65a5-86de-4984-a5bd-01a0aeb3a726 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:43.933118 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d65a5-86de-4984-a5bd-01a0aeb3a726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:43.961389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-9b7d65a5-86de-4984-a5bd-01a0aeb3a726 None None] MFA Rules not processed for user `10109ab264f2468793f720ae838260d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:43.962679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9b7d65a5-86de-4984-a5bd-01a0aeb3a726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:44.164687 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1360/2712] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:44.174284 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09d46e-c17d-42b6-8693-7574d45ab98a admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:44.176232 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-5a09d46e-c17d-42b6-8693-7574d45ab98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:44.240749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09d46e-c17d-42b6-8693-7574d45ab98a admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:44.244386 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fd8c8-5669-4601-a1a3-c1e58f2a8923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:44.245038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fd8c8-5669-4601-a1a3-c1e58f2a8923 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:44.245321 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fd8c8-5669-4601-a1a3-c1e58f2a8923 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:44.245596 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fd8c8-5669-4601-a1a3-c1e58f2a8923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:44.253796 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fd8c8-5669-4601-a1a3-c1e58f2a8923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:44.255279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fd8c8-5669-4601-a1a3-c1e58f2a8923 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:44.263894 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1353/2713] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:45.606960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939e0b4-c1bd-4502-85d1-e9c4e106653a None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:45.607488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939e0b4-c1bd-4502-85d1-e9c4e106653a None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:45.607488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939e0b4-c1bd-4502-85d1-e9c4e106653a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:45.625376 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-0939e0b4-c1bd-4502-85d1-e9c4e106653a None None] MFA Rules not processed for user `10109ab264f2468793f720ae838260d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:45.626624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0939e0b4-c1bd-4502-85d1-e9c4e106653a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:45.633630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1361/2714] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:44:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:00.396529 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b54f49-1c6f-43ac-a32e-382e1a9dd069 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:00.397065 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b54f49-1c6f-43ac-a32e-382e1a9dd069 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:00.397175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b54f49-1c6f-43ac-a32e-382e1a9dd069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:00.415713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e5b54f49-1c6f-43ac-a32e-382e1a9dd069 None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:00.416887 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e5b54f49-1c6f-43ac-a32e-382e1a9dd069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:00.470347 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1354/2715] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:45:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:00.493968 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939e0b4-c1bd-4502-85d1-e9c4e106653a None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:00.495055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0939e0b4-c1bd-4502-85d1-e9c4e106653a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:00.559730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939e0b4-c1bd-4502-85d1-e9c4e106653a None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:00.564681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e993f-81a6-42a2-817d-d74fdf7dd11a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:00.565315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e993f-81a6-42a2-817d-d74fdf7dd11a service swift] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:00.565625 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e993f-81a6-42a2-817d-d74fdf7dd11a service swift] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:00.565898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e993f-81a6-42a2-817d-d74fdf7dd11a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:00.573876 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e993f-81a6-42a2-817d-d74fdf7dd11a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:00.575474 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e993f-81a6-42a2-817d-d74fdf7dd11a service swift] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:00.583839 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1362/2716] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:45:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:45:01.085380 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a397d7-af32-4b43-b918-19c3649e346b None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:01.085657 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a397d7-af32-4b43-b918-19c3649e346b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:01.085933 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a397d7-af32-4b43-b918-19c3649e346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:01.103384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-21a397d7-af32-4b43-b918-19c3649e346b None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:01.104553 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-21a397d7-af32-4b43-b918-19c3649e346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:01.111837 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1355/2717] 10.222.0.79 () {58 vars in 967 bytes} [Mon Feb 21 01:45:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:01.124681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e993f-81a6-42a2-817d-d74fdf7dd11a service swift] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:01.134969 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e993f-81a6-42a2-817d-d74fdf7dd11a service swift] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:01.140496 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d475b-f889-44af-90b8-74ac8eb006a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:01.141122 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d475b-f889-44af-90b8-74ac8eb006a6 service swift] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:01.141403 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d475b-f889-44af-90b8-74ac8eb006a6 service swift] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:01.141679 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d475b-f889-44af-90b8-74ac8eb006a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:01.149617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d475b-f889-44af-90b8-74ac8eb006a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:01.151218 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d475b-f889-44af-90b8-74ac8eb006a6 service swift] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:01.159128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1363/2718] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:45:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:45:01.340817 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e686-ea08-43ca-9b24-806249141761 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:01.341098 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e686-ea08-43ca-9b24-806249141761 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:01.341370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e686-ea08-43ca-9b24-806249141761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:01.358797 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f869e686-ea08-43ca-9b24-806249141761 None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:01.359946 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f869e686-ea08-43ca-9b24-806249141761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:01.367109 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1356/2719] 10.222.0.79 () {58 vars in 1009 bytes} [Mon Feb 21 01:45:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:01.379250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d475b-f889-44af-90b8-74ac8eb006a6 service swift] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:01.389251 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d475b-f889-44af-90b8-74ac8eb006a6 service swift] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:01.394379 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee56aa-dece-419b-ba2a-ca7c73957d8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:01.395003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee56aa-dece-419b-ba2a-ca7c73957d8f service swift] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:01.395283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee56aa-dece-419b-ba2a-ca7c73957d8f service swift] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:01.395555 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee56aa-dece-419b-ba2a-ca7c73957d8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:01.403730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee56aa-dece-419b-ba2a-ca7c73957d8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:01.405383 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee56aa-dece-419b-ba2a-ca7c73957d8f service swift] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:01.413240 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1364/2720] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:45:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:45:01.713242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a7042-93e3-494f-a190-6f6125a3f95c None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:01.713725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a7042-93e3-494f-a190-6f6125a3f95c None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:01.713836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a7042-93e3-494f-a190-6f6125a3f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:01.731490 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f93a7042-93e3-494f-a190-6f6125a3f95c None None] MFA Rules not processed for user `19893604215b4bd397178347775e0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:01.733274 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f93a7042-93e3-494f-a190-6f6125a3f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:01.740682 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1357/2721] 10.222.0.79 () {58 vars in 967 bytes} [Mon Feb 21 01:45:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:01.752629 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee56aa-dece-419b-ba2a-ca7c73957d8f service swift] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:01.762817 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee56aa-dece-419b-ba2a-ca7c73957d8f service swift] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:01.767781 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79040379-0f02-4125-805c-a8da692dd6bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cb0a0d56f0049b19ba22e0dd041897e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:01.768401 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79040379-0f02-4125-805c-a8da692dd6bf service swift] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:01.768684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79040379-0f02-4125-805c-a8da692dd6bf service swift] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:01.768957 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79040379-0f02-4125-805c-a8da692dd6bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:01.776729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79040379-0f02-4125-805c-a8da692dd6bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:01.778309 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79040379-0f02-4125-805c-a8da692dd6bf service swift] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:01.786585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1365/2722] 10.222.0.79 () {60 vars in 1384 bytes} [Mon Feb 21 01:45:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:45:03.742458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a7042-93e3-494f-a190-6f6125a3f95c None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:03.804303 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a7042-93e3-494f-a190-6f6125a3f95c None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:03.809927 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:03.810997 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:03.811283 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:03.811554 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] PATH_INFO: `/v3/users/10109ab264f2468793f720ae838260d9` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:03.812827 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10109ab264f2468793f720ae838260d9)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:03.815126 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:03.861928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10109ab264f2468793f720ae838260d9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:03.869071 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10109ab264f2468793f720ae838260d9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:03.881107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10109ab264f2468793f720ae838260d9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:03.881792 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10109ab264f2468793f720ae838260d9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:03.882438 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10109ab264f2468793f720ae838260d9'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:03.896076 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1358/2723] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:45:03 2022] DELETE /identity/v3/users/10109ab264f2468793f720ae838260d9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:45:03.900648 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fb4ed-3bea-44c0-a488-02cfde83371b None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:03.901128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fb4ed-3bea-44c0-a488-02cfde83371b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:03.901236 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fb4ed-3bea-44c0-a488-02cfde83371b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:03.919091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-c29fb4ed-3bea-44c0-a488-02cfde83371b None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:03.920265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c29fb4ed-3bea-44c0-a488-02cfde83371b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:03.975880 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1366/2724] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:03.985142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:03.986834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:04.040789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0081ef3-bd99-47a8-b373-54ebfcad90a3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:04.044348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0239-e825-44bd-b31c-4596275a2d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:04.044991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0239-e825-44bd-b31c-4596275a2d92 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:04.045268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0239-e825-44bd-b31c-4596275a2d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:04.045536 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0239-e825-44bd-b31c-4596275a2d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:04.054546 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb0239-e825-44bd-b31c-4596275a2d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:04.055953 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb0239-e825-44bd-b31c-4596275a2d92 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:04.065479 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1359/2725] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:45:04.227855 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fb4ed-3bea-44c0-a488-02cfde83371b None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:04.229231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c29fb4ed-3bea-44c0-a488-02cfde83371b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:04.241171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fb4ed-3bea-44c0-a488-02cfde83371b None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:04.245669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:04.246545 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:04.246821 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:04.247088 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] PATH_INFO: `/v3/projects/b66e423d409949a1a7908400e6972e43` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:04.248743 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66e423d409949a1a7908400e6972e43)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:04.250774 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:04.294598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66e423d409949a1a7908400e6972e43', 'request_id': 'req-8f923b69-ed41-4276-badc-c3377b6dbfaa'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:04.299822 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66e423d409949a1a7908400e6972e43', 'request_id': 'req-8f923b69-ed41-4276-badc-c3377b6dbfaa'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:04.307330 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66e423d409949a1a7908400e6972e43', 'request_id': 'req-8f923b69-ed41-4276-badc-c3377b6dbfaa'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:04.318976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] The token cache is being invalidate because project b66e423d409949a1a7908400e6972e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:45:04.319261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:04.319882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:04.321396 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1367/2726] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:45:04 2022] DELETE /identity/v3/projects/b66e423d409949a1a7908400e6972e43 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:45:11.871432 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0239-e825-44bd-b31c-4596275a2d92 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:11.879937 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0239-e825-44bd-b31c-4596275a2d92 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:11.929931 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db41f32-e2ac-4850-8051-4bc46649c149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:11.930954 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db41f32-e2ac-4850-8051-4bc46649c149 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:11.931462 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db41f32-e2ac-4850-8051-4bc46649c149 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:11.931893 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db41f32-e2ac-4850-8051-4bc46649c149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:11.933664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-7db41f32-e2ac-4850-8051-4bc46649c149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:12.008125 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db41f32-e2ac-4850-8051-4bc46649c149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:12.009617 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db41f32-e2ac-4850-8051-4bc46649c149 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:12.026921 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1360/2727] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:45:15.227369 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:15.228903 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:15.242866 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923b69-ed41-4276-badc-c3377b6dbfaa admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:15.247143 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900d71a-650d-49c6-a957-7f8d2d523ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:15.248003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900d71a-650d-49c6-a957-7f8d2d523ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:15.248313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900d71a-650d-49c6-a957-7f8d2d523ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:15.248588 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900d71a-650d-49c6-a957-7f8d2d523ed3 admin admin] PATH_INFO: `/v3/users/faac09d2bacd4759ada261c83b83362e` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:15.249759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900d71a-650d-49c6-a957-7f8d2d523ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faac09d2bacd4759ada261c83b83362e)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:15.251684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900d71a-650d-49c6-a957-7f8d2d523ed3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:15.296379 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-6900d71a-650d-49c6-a957-7f8d2d523ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faac09d2bacd4759ada261c83b83362e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:15.304419 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-6900d71a-650d-49c6-a957-7f8d2d523ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faac09d2bacd4759ada261c83b83362e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:15.315790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-6900d71a-650d-49c6-a957-7f8d2d523ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faac09d2bacd4759ada261c83b83362e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:15.316423 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-6900d71a-650d-49c6-a957-7f8d2d523ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faac09d2bacd4759ada261c83b83362e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:15.322986 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-6900d71a-650d-49c6-a957-7f8d2d523ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faac09d2bacd4759ada261c83b83362e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:15.329102 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1368/2728] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:45:15 2022] DELETE /identity/v3/users/faac09d2bacd4759ada261c83b83362e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:45:15.502501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db41f32-e2ac-4850-8051-4bc46649c149 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:15.513667 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db41f32-e2ac-4850-8051-4bc46649c149 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:15.570268 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6111c-2d9a-4fe3-9040-7475af1fca51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:15.571120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6111c-2d9a-4fe3-9040-7475af1fca51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:15.571403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6111c-2d9a-4fe3-9040-7475af1fca51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:15.571679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6111c-2d9a-4fe3-9040-7475af1fca51 admin admin] PATH_INFO: `/v3/projects/1d4fde563e8d4358b1f8d7c778e7dc59` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:15.572848 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6111c-2d9a-4fe3-9040-7475af1fca51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4fde563e8d4358b1f8d7c778e7dc59)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:15.574781 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6111c-2d9a-4fe3-9040-7475af1fca51 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:15.619119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ffc6111c-2d9a-4fe3-9040-7475af1fca51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4fde563e8d4358b1f8d7c778e7dc59', 'request_id': 'req-ffc6111c-2d9a-4fe3-9040-7475af1fca51'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:15.624931 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ffc6111c-2d9a-4fe3-9040-7475af1fca51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4fde563e8d4358b1f8d7c778e7dc59', 'request_id': 'req-ffc6111c-2d9a-4fe3-9040-7475af1fca51'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:15.632107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ffc6111c-2d9a-4fe3-9040-7475af1fca51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4fde563e8d4358b1f8d7c778e7dc59', 'request_id': 'req-ffc6111c-2d9a-4fe3-9040-7475af1fca51'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:15.642577 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ffc6111c-2d9a-4fe3-9040-7475af1fca51 admin admin] The token cache is being invalidate because project 1d4fde563e8d4358b1f8d7c778e7dc59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:45:15.642859 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ffc6111c-2d9a-4fe3-9040-7475af1fca51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:15.643483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-ffc6111c-2d9a-4fe3-9040-7475af1fca51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:15.644995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1361/2729] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:45:15 2022] DELETE /identity/v3/projects/1d4fde563e8d4358b1f8d7c778e7dc59 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:45:15.649835 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da9ad9-c0c5-4a64-8def-52d68b11d9e0 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:15.650122 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da9ad9-c0c5-4a64-8def-52d68b11d9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:15.650427 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da9ad9-c0c5-4a64-8def-52d68b11d9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:15.668536 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b8da9ad9-c0c5-4a64-8def-52d68b11d9e0 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:15.669709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b8da9ad9-c0c5-4a64-8def-52d68b11d9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:15.727544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1369/2730] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:15.735227 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6ccb-bef0-4c09-9828-c18c6045bd1f None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:15.735544 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6ccb-bef0-4c09-9828-c18c6045bd1f None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:15.735821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6ccb-bef0-4c09-9828-c18c6045bd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:15.753905 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-324e6ccb-bef0-4c09-9828-c18c6045bd1f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:15.755117 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-324e6ccb-bef0-4c09-9828-c18c6045bd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:15.762806 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1362/2731] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:15.767481 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da9ad9-c0c5-4a64-8def-52d68b11d9e0 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:15.776753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da9ad9-c0c5-4a64-8def-52d68b11d9e0 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:15.781836 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef775e67-8de3-4b20-9b0e-d793b4d3b6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:15.782514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef775e67-8de3-4b20-9b0e-d793b4d3b6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:15.782798 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef775e67-8de3-4b20-9b0e-d793b4d3b6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:15.783072 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef775e67-8de3-4b20-9b0e-d793b4d3b6f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:15.783790 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef775e67-8de3-4b20-9b0e-d793b4d3b6f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:45:15.784097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef775e67-8de3-4b20-9b0e-d793b4d3b6f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:15.785689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef775e67-8de3-4b20-9b0e-d793b4d3b6f3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:15.803168 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1370/2732] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:45:15.807465 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e6ccb-bef0-4c09-9828-c18c6045bd1f None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:15.816666 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e6ccb-bef0-4c09-9828-c18c6045bd1f None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:15.821676 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcbf2c-3179-45ec-925f-a52ca0289f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:15.822356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcbf2c-3179-45ec-925f-a52ca0289f1c admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:15.822653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcbf2c-3179-45ec-925f-a52ca0289f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:15.823033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcbf2c-3179-45ec-925f-a52ca0289f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:15.824114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcbf2c-3179-45ec-925f-a52ca0289f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:15.826038 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcbf2c-3179-45ec-925f-a52ca0289f1c admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:15.852299 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1363/2733] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:45:15 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:45:15.856393 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef775e67-8de3-4b20-9b0e-d793b4d3b6f3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:15.866311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef775e67-8de3-4b20-9b0e-d793b4d3b6f3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:15.918753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca123345-ffc7-4988-9eec-709d1ae8d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:15.919406 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123345-ffc7-4988-9eec-709d1ae8d516 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:15.919685 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123345-ffc7-4988-9eec-709d1ae8d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:15.919976 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123345-ffc7-4988-9eec-709d1ae8d516 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:15.920645 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca123345-ffc7-4988-9eec-709d1ae8d516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:15.922544 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca123345-ffc7-4988-9eec-709d1ae8d516 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:15.941746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1371/2734] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:45:15 2022] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:45:15.945866 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcbf2c-3179-45ec-925f-a52ca0289f1c admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:15.957331 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcbf2c-3179-45ec-925f-a52ca0289f1c admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:15.962224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cf594-d9d0-4166-a673-d3dfd9a8ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:15.962874 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cf594-d9d0-4166-a673-d3dfd9a8ef5b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:15.963151 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cf594-d9d0-4166-a673-d3dfd9a8ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:15.963423 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cf594-d9d0-4166-a673-d3dfd9a8ef5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:15.964145 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cf594-d9d0-4166-a673-d3dfd9a8ef5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:15.965749 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cf594-d9d0-4166-a673-d3dfd9a8ef5b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:15.975744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1364/2735] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:45:15.979583 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca123345-ffc7-4988-9eec-709d1ae8d516 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:15.989509 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca123345-ffc7-4988-9eec-709d1ae8d516 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:15.994028 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c71bd-92ed-491b-939b-83f66b323367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:15.994701 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c71bd-92ed-491b-939b-83f66b323367 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:15.994983 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c71bd-92ed-491b-939b-83f66b323367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:15.995311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c71bd-92ed-491b-939b-83f66b323367 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:15.995987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c71bd-92ed-491b-939b-83f66b323367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:15.997595 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c71bd-92ed-491b-939b-83f66b323367 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:16.009127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1372/2736] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:45:16.013123 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cf594-d9d0-4166-a673-d3dfd9a8ef5b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:16.023618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cf594-d9d0-4166-a673-d3dfd9a8ef5b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:16.028298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086dada-a502-4b06-9630-aac9f66b4f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:16.029269 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086dada-a502-4b06-9630-aac9f66b4f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:16.029678 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086dada-a502-4b06-9630-aac9f66b4f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:16.030032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086dada-a502-4b06-9630-aac9f66b4f90 admin admin] PATH_INFO: `/v3/projects/47579e492b9844beaf514c91416a5329/users/89de07d1dee14c3daa3a4a246e634043/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:16.044546 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086dada-a502-4b06-9630-aac9f66b4f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47579e492b9844beaf514c91416a5329, user_id=89de07d1dee14c3daa3a4a246e634043, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:16.047389 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086dada-a502-4b06-9630-aac9f66b4f90 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:16.062859 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1365/2737] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:45:16 2022] PUT /identity/v3/projects/47579e492b9844beaf514c91416a5329/users/89de07d1dee14c3daa3a4a246e634043/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:45:16.067899 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9591b82-774c-477e-8070-0a737c970a80 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:16.068201 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9591b82-774c-477e-8070-0a737c970a80 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:16.068457 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9591b82-774c-477e-8070-0a737c970a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:16.085840 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a9591b82-774c-477e-8070-0a737c970a80 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:16.087061 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a9591b82-774c-477e-8070-0a737c970a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:16.155818 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1373/2738] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:16.165307 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086dada-a502-4b06-9630-aac9f66b4f90 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:16.167059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6086dada-a502-4b06-9630-aac9f66b4f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:16.221967 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086dada-a502-4b06-9630-aac9f66b4f90 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:16.225742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5c501-2728-4bae-bb0a-92301ee0853f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:16.226452 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5c501-2728-4bae-bb0a-92301ee0853f service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:16.226738 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5c501-2728-4bae-bb0a-92301ee0853f service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:16.227015 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5c501-2728-4bae-bb0a-92301ee0853f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:16.236009 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5c501-2728-4bae-bb0a-92301ee0853f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:16.237366 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5c501-2728-4bae-bb0a-92301ee0853f service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:16.246710 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1366/2739] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:45:16.825774 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309de37-9761-4383-813f-9f66381fddde None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:16.826302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309de37-9761-4383-813f-9f66381fddde None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:16.826415 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309de37-9761-4383-813f-9f66381fddde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:16.853550 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-9309de37-9761-4383-813f-9f66381fddde None None] MFA Rules not processed for user `89de07d1dee14c3daa3a4a246e634043`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:16.854780 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9309de37-9761-4383-813f-9f66381fddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:16.917232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1374/2740] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:16.929008 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c8387-8ab4-4b4b-a106-ca80d5b33c75 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:16.929559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c8387-8ab4-4b4b-a106-ca80d5b33c75 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:16.929559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c8387-8ab4-4b4b-a106-ca80d5b33c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:16.946987 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f40c8387-8ab4-4b4b-a106-ca80d5b33c75 None None] MFA Rules not processed for user `89de07d1dee14c3daa3a4a246e634043`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:16.948166 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f40c8387-8ab4-4b4b-a106-ca80d5b33c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:16.955411 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1367/2741] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:16.966684 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309de37-9761-4383-813f-9f66381fddde None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:16.969711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-9309de37-9761-4383-813f-9f66381fddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:17.042163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309de37-9761-4383-813f-9f66381fddde None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:17.048415 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2e06f-92b2-4508-aabb-b022f98333d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:17.049057 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2e06f-92b2-4508-aabb-b022f98333d6 service nova] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:17.049342 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2e06f-92b2-4508-aabb-b022f98333d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:17.049618 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2e06f-92b2-4508-aabb-b022f98333d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:17.057319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2e06f-92b2-4508-aabb-b022f98333d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:17.059006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2e06f-92b2-4508-aabb-b022f98333d6 service nova] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:17.067606 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1375/2742] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:45:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:45:36.196479 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56ca98-78da-44be-9dcb-67a86bcf5040 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:36.197011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56ca98-78da-44be-9dcb-67a86bcf5040 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:36.197011 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56ca98-78da-44be-9dcb-67a86bcf5040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:36.213789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-9f56ca98-78da-44be-9dcb-67a86bcf5040 None None] MFA Rules not processed for user `89de07d1dee14c3daa3a4a246e634043`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:36.214986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9f56ca98-78da-44be-9dcb-67a86bcf5040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:36.222252 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1368/2743] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:45:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:36.461021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2e06f-92b2-4508-aabb-b022f98333d6 service nova] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:36.470920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2e06f-92b2-4508-aabb-b022f98333d6 service nova] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:36.474471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a52781-cadd-4720-b11c-4902a3f5537f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:36.475095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a52781-cadd-4720-b11c-4902a3f5537f service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:36.475375 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a52781-cadd-4720-b11c-4902a3f5537f service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:36.475651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a52781-cadd-4720-b11c-4902a3f5537f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:36.477382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-73a52781-cadd-4720-b11c-4902a3f5537f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:36.487138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a52781-cadd-4720-b11c-4902a3f5537f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:36.488803 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a52781-cadd-4720-b11c-4902a3f5537f service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:36.496646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1376/2744] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:45:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:45:47.710002 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f91bc-4fdc-47aa-8379-6931e6ac492b None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:47.710557 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f91bc-4fdc-47aa-8379-6931e6ac492b None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:47.710664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f91bc-4fdc-47aa-8379-6931e6ac492b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:47.728105 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-6b7f91bc-4fdc-47aa-8379-6931e6ac492b None None] MFA Rules not processed for user `89de07d1dee14c3daa3a4a246e634043`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:47.729277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6b7f91bc-4fdc-47aa-8379-6931e6ac492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:47.736603 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1369/2745] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:45:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:46:07.114145 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7846cf3-1983-4882-b7d1-70812f39aa86 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:07.114676 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7846cf3-1983-4882-b7d1-70812f39aa86 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:07.114796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7846cf3-1983-4882-b7d1-70812f39aa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:07.131425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-b7846cf3-1983-4882-b7d1-70812f39aa86 None None] MFA Rules not processed for user `89de07d1dee14c3daa3a4a246e634043`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:46:07.132571 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b7846cf3-1983-4882-b7d1-70812f39aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:07.139152 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1377/2746] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:46:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:46:09.772179 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f91bc-4fdc-47aa-8379-6931e6ac492b None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:09.793556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f91bc-4fdc-47aa-8379-6931e6ac492b None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:09.800138 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a65ca-4873-494e-a58a-97f23bfdfe33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333ec5b3842b432a99bc265abbe7fa58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:09.801101 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a65ca-4873-494e-a58a-97f23bfdfe33 service nova] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:09.801390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a65ca-4873-494e-a58a-97f23bfdfe33 service nova] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:09.801668 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a65ca-4873-494e-a58a-97f23bfdfe33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:09.803680 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-553a65ca-4873-494e-a58a-97f23bfdfe33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:09.821376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a65ca-4873-494e-a58a-97f23bfdfe33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:09.823350 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a65ca-4873-494e-a58a-97f23bfdfe33 service nova] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:09.848030 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1370/2747] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:46:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:46:12.544483 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7846cf3-1983-4882-b7d1-70812f39aa86 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:12.545853 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b7846cf3-1983-4882-b7d1-70812f39aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:12.622523 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7846cf3-1983-4882-b7d1-70812f39aa86 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:12.628580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218585-80c7-4123-91c2-c12193cd1653 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02e7385005924d4f8c220c986b9866de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:12.629242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218585-80c7-4123-91c2-c12193cd1653 service placement] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:12.629527 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218585-80c7-4123-91c2-c12193cd1653 service placement] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:12.629802 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218585-80c7-4123-91c2-c12193cd1653 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:12.631740 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-01218585-80c7-4123-91c2-c12193cd1653 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:12.643877 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01218585-80c7-4123-91c2-c12193cd1653 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:12.645512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01218585-80c7-4123-91c2-c12193cd1653 service placement] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:12.655277 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1378/2748] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:46:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:46:13.841527 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a65ca-4873-494e-a58a-97f23bfdfe33 service nova] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:13.843115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-553a65ca-4873-494e-a58a-97f23bfdfe33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:13.855144 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a65ca-4873-494e-a58a-97f23bfdfe33 service nova] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:13.859401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86afe64-f79e-4639-8596-e6ecf3f60c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:13.860088 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86afe64-f79e-4639-8596-e6ecf3f60c1e service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:13.860349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86afe64-f79e-4639-8596-e6ecf3f60c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:13.860625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86afe64-f79e-4639-8596-e6ecf3f60c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:13.862687 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b86afe64-f79e-4639-8596-e6ecf3f60c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:13.875577 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86afe64-f79e-4639-8596-e6ecf3f60c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:13.877191 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86afe64-f79e-4639-8596-e6ecf3f60c1e service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:13.887209 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1371/2749] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:46:17.024226 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218585-80c7-4123-91c2-c12193cd1653 service placement] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:17.025717 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-01218585-80c7-4123-91c2-c12193cd1653 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:17.130303 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218585-80c7-4123-91c2-c12193cd1653 service placement] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:17.135420 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bf3b9-9181-4d10-bb04-be2f50e8b1a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:17.136361 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bf3b9-9181-4d10-bb04-be2f50e8b1a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:17.136616 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bf3b9-9181-4d10-bb04-be2f50e8b1a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:17.137066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bf3b9-9181-4d10-bb04-be2f50e8b1a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:17.139829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-339bf3b9-9181-4d10-bb04-be2f50e8b1a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:17.224456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bf3b9-9181-4d10-bb04-be2f50e8b1a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:17.225921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bf3b9-9181-4d10-bb04-be2f50e8b1a8 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:17.247820 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1379/2750] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:46:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:46:20.322679 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86afe64-f79e-4639-8596-e6ecf3f60c1e service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:20.324137 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b86afe64-f79e-4639-8596-e6ecf3f60c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:20.336909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86afe64-f79e-4639-8596-e6ecf3f60c1e service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:20.341908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:20.342834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:20.343113 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:20.343946 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] PATH_INFO: `/v3/users/a01201ddd64c4731992569cc38ca2276` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:20.345161 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01201ddd64c4731992569cc38ca2276)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:20.347835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:20.402632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01201ddd64c4731992569cc38ca2276'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.412793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01201ddd64c4731992569cc38ca2276'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.427516 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01201ddd64c4731992569cc38ca2276'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.428292 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01201ddd64c4731992569cc38ca2276'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.428913 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01201ddd64c4731992569cc38ca2276'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.446758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1372/2751] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:46:20 2022] DELETE /identity/v3/users/a01201ddd64c4731992569cc38ca2276 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:46:20.619643 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bf3b9-9181-4d10-bb04-be2f50e8b1a8 service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:20.631788 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bf3b9-9181-4d10-bb04-be2f50e8b1a8 service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:20.685443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd4aae-1081-47a9-abd6-81b230fe06cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:20.686315 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd4aae-1081-47a9-abd6-81b230fe06cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:20.686591 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd4aae-1081-47a9-abd6-81b230fe06cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:20.686856 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd4aae-1081-47a9-abd6-81b230fe06cd admin admin] PATH_INFO: `/v3/projects/4f7dbed5840d4227ab62e42f9a49fbce` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:20.688041 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd4aae-1081-47a9-abd6-81b230fe06cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7dbed5840d4227ab62e42f9a49fbce)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:20.689925 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd4aae-1081-47a9-abd6-81b230fe06cd admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:20.743003 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8cdd4aae-1081-47a9-abd6-81b230fe06cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7dbed5840d4227ab62e42f9a49fbce', 'request_id': 'req-8cdd4aae-1081-47a9-abd6-81b230fe06cd'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.748171 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8cdd4aae-1081-47a9-abd6-81b230fe06cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7dbed5840d4227ab62e42f9a49fbce', 'request_id': 'req-8cdd4aae-1081-47a9-abd6-81b230fe06cd'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.755382 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8cdd4aae-1081-47a9-abd6-81b230fe06cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7dbed5840d4227ab62e42f9a49fbce', 'request_id': 'req-8cdd4aae-1081-47a9-abd6-81b230fe06cd'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.768163 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8cdd4aae-1081-47a9-abd6-81b230fe06cd admin admin] The token cache is being invalidate because project 4f7dbed5840d4227ab62e42f9a49fbce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:46:20.768453 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8cdd4aae-1081-47a9-abd6-81b230fe06cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.769097 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-8cdd4aae-1081-47a9-abd6-81b230fe06cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.770680 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1380/2752] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:46:20 2022] DELETE /identity/v3/projects/4f7dbed5840d4227ab62e42f9a49fbce => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:46:20.774660 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:20.776033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:20.789699 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25801727-73f1-4e15-94e5-0407ed85e1bc admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:20.817390 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979245ed-e90b-4074-860d-8141307b1e85 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:20.817713 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979245ed-e90b-4074-860d-8141307b1e85 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:20.818066 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979245ed-e90b-4074-860d-8141307b1e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:20.836032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-979245ed-e90b-4074-860d-8141307b1e85 None None] MFA Rules not processed for user `d40b20a8c16d4771b4410f975e9f2a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:46:20.837234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-979245ed-e90b-4074-860d-8141307b1e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:20.846993 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:20.847883 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:20.848157 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:20.848425 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] PATH_INFO: `/v3/users/e9cb832c2164492b877a7a6c33c9c173` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:20.849595 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9cb832c2164492b877a7a6c33c9c173)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:20.851515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:20.898599 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1381/2753] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:46:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:46:20.905461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9cb832c2164492b877a7a6c33c9c173'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.912986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9cb832c2164492b877a7a6c33c9c173'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.926133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9cb832c2164492b877a7a6c33c9c173'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.927656 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9cb832c2164492b877a7a6c33c9c173'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.928458 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9cb832c2164492b877a7a6c33c9c173'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:20.943774 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1373/2754] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:46:20 2022] DELETE /identity/v3/users/e9cb832c2164492b877a7a6c33c9c173 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:46:21.288894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979245ed-e90b-4074-860d-8141307b1e85 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:21.290784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-979245ed-e90b-4074-860d-8141307b1e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:21.324203 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979245ed-e90b-4074-860d-8141307b1e85 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:21.388609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:21.389617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:21.389891 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:21.390186 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] PATH_INFO: `/v3/projects/6425825058c64ef28ff75d9f98ca3039` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:21.391389 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6425825058c64ef28ff75d9f98ca3039)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:21.393321 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:21.441668 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6425825058c64ef28ff75d9f98ca3039', 'request_id': 'req-befb3a27-d115-4528-9b7e-477bbd90c11e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:21.446953 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6425825058c64ef28ff75d9f98ca3039', 'request_id': 'req-befb3a27-d115-4528-9b7e-477bbd90c11e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:21.455589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6425825058c64ef28ff75d9f98ca3039', 'request_id': 'req-befb3a27-d115-4528-9b7e-477bbd90c11e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:21.466706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] The token cache is being invalidate because project 6425825058c64ef28ff75d9f98ca3039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:46:21.466989 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:21.467638 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:21.469784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1382/2755] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:46:21 2022] DELETE /identity/v3/projects/6425825058c64ef28ff75d9f98ca3039 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:46:48.681783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:48.683290 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:48.696558 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f84f7-700f-4215-9787-3af6e2433ff4 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:48.749580 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3095000-52b4-4338-9827-9630f9c9bcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:48.750478 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3095000-52b4-4338-9827-9630f9c9bcdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:48.751385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3095000-52b4-4338-9827-9630f9c9bcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:48.751663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3095000-52b4-4338-9827-9630f9c9bcdc admin admin] PATH_INFO: `/v3/users/89de07d1dee14c3daa3a4a246e634043` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:48.752847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3095000-52b4-4338-9827-9630f9c9bcdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=89de07d1dee14c3daa3a4a246e634043)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:48.754792 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3095000-52b4-4338-9827-9630f9c9bcdc admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:48.800281 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e3095000-52b4-4338-9827-9630f9c9bcdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89de07d1dee14c3daa3a4a246e634043'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:48.806672 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e3095000-52b4-4338-9827-9630f9c9bcdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89de07d1dee14c3daa3a4a246e634043'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:48.817727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e3095000-52b4-4338-9827-9630f9c9bcdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89de07d1dee14c3daa3a4a246e634043'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:48.818412 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e3095000-52b4-4338-9827-9630f9c9bcdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89de07d1dee14c3daa3a4a246e634043'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:48.819019 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-e3095000-52b4-4338-9827-9630f9c9bcdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89de07d1dee14c3daa3a4a246e634043'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:48.831305 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1374/2756] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:46:48 2022] DELETE /identity/v3/users/89de07d1dee14c3daa3a4a246e634043 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:46:49.018157 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:49.019677 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:49.039705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3a27-d115-4528-9b7e-477bbd90c11e admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:49.095891 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83800208-b0be-41fd-b4cb-ffc494f38333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:49.096750 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83800208-b0be-41fd-b4cb-ffc494f38333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.097033 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83800208-b0be-41fd-b4cb-ffc494f38333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.097306 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83800208-b0be-41fd-b4cb-ffc494f38333 admin admin] PATH_INFO: `/v3/projects/47579e492b9844beaf514c91416a5329` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.098525 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83800208-b0be-41fd-b4cb-ffc494f38333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47579e492b9844beaf514c91416a5329)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:49.100428 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83800208-b0be-41fd-b4cb-ffc494f38333 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:49.147020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-83800208-b0be-41fd-b4cb-ffc494f38333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47579e492b9844beaf514c91416a5329', 'request_id': 'req-83800208-b0be-41fd-b4cb-ffc494f38333'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:49.152080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-83800208-b0be-41fd-b4cb-ffc494f38333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47579e492b9844beaf514c91416a5329', 'request_id': 'req-83800208-b0be-41fd-b4cb-ffc494f38333'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:49.159371 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-83800208-b0be-41fd-b4cb-ffc494f38333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47579e492b9844beaf514c91416a5329', 'request_id': 'req-83800208-b0be-41fd-b4cb-ffc494f38333'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:49.170102 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-83800208-b0be-41fd-b4cb-ffc494f38333 admin admin] The token cache is being invalidate because project 47579e492b9844beaf514c91416a5329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:46:49.170443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-83800208-b0be-41fd-b4cb-ffc494f38333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:49.171053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-83800208-b0be-41fd-b4cb-ffc494f38333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:49.172538 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1383/2757] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:46:49 2022] DELETE /identity/v3/projects/47579e492b9844beaf514c91416a5329 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:46:49.177548 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c1b7d-6cef-4e0b-9bd2-2eb567c75e83 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.177835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c1b7d-6cef-4e0b-9bd2-2eb567c75e83 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.178115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c1b7d-6cef-4e0b-9bd2-2eb567c75e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.195348 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-ee0c1b7d-6cef-4e0b-9bd2-2eb567c75e83 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:46:49.196507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ee0c1b7d-6cef-4e0b-9bd2-2eb567c75e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:49.251799 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1375/2758] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:46:49.259707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63900d60-518c-47c7-ae86-68e7da7970f2 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.259999 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63900d60-518c-47c7-ae86-68e7da7970f2 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.260272 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63900d60-518c-47c7-ae86-68e7da7970f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.278456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-63900d60-518c-47c7-ae86-68e7da7970f2 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:46:49.279617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-63900d60-518c-47c7-ae86-68e7da7970f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:49.287877 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1384/2759] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:46:49.291961 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c1b7d-6cef-4e0b-9bd2-2eb567c75e83 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:49.301160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c1b7d-6cef-4e0b-9bd2-2eb567c75e83 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:49.305620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f034b-898c-4db3-b869-d4291f7dbab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:49.306285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f034b-898c-4db3-b869-d4291f7dbab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.306567 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f034b-898c-4db3-b869-d4291f7dbab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.306834 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f034b-898c-4db3-b869-d4291f7dbab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.307542 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f034b-898c-4db3-b869-d4291f7dbab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:46:49.307841 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f034b-898c-4db3-b869-d4291f7dbab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:49.309400 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f034b-898c-4db3-b869-d4291f7dbab1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:49.320353 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1376/2760] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:46:49.324532 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63900d60-518c-47c7-ae86-68e7da7970f2 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:49.333950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63900d60-518c-47c7-ae86-68e7da7970f2 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:49.338578 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847aa89-7348-482d-b460-cc740d4623a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:49.339207 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847aa89-7348-482d-b460-cc740d4623a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.339512 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847aa89-7348-482d-b460-cc740d4623a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.339784 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847aa89-7348-482d-b460-cc740d4623a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.340459 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847aa89-7348-482d-b460-cc740d4623a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:49.342366 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847aa89-7348-482d-b460-cc740d4623a4 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:49.367456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1385/2761] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:46:49 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:46:49.371342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f034b-898c-4db3-b869-d4291f7dbab1 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:49.380861 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f034b-898c-4db3-b869-d4291f7dbab1 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:49.433960 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf77fa4-f0e8-448c-8dbd-0fe463827452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:49.434647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77fa4-f0e8-448c-8dbd-0fe463827452 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.434923 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77fa4-f0e8-448c-8dbd-0fe463827452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.435199 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77fa4-f0e8-448c-8dbd-0fe463827452 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.435966 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf77fa4-f0e8-448c-8dbd-0fe463827452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:49.438160 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf77fa4-f0e8-448c-8dbd-0fe463827452 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:49.457573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1377/2762] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:46:49 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:46:49.461623 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847aa89-7348-482d-b460-cc740d4623a4 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:49.472240 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847aa89-7348-482d-b460-cc740d4623a4 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:49.476809 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd001b-1b0e-4a24-bca2-e013ed540b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:49.477448 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd001b-1b0e-4a24-bca2-e013ed540b6d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.477729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd001b-1b0e-4a24-bca2-e013ed540b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.478004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd001b-1b0e-4a24-bca2-e013ed540b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.478759 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd001b-1b0e-4a24-bca2-e013ed540b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:49.480429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd001b-1b0e-4a24-bca2-e013ed540b6d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:49.490585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1386/2763] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:46:49.494326 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf77fa4-f0e8-448c-8dbd-0fe463827452 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:49.503754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf77fa4-f0e8-448c-8dbd-0fe463827452 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:49.508356 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a69650-d9e6-4165-ac41-b2e33b4d4bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:49.508989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a69650-d9e6-4165-ac41-b2e33b4d4bcb admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.509266 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a69650-d9e6-4165-ac41-b2e33b4d4bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.509533 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a69650-d9e6-4165-ac41-b2e33b4d4bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.510279 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a69650-d9e6-4165-ac41-b2e33b4d4bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:49.511840 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a69650-d9e6-4165-ac41-b2e33b4d4bcb admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:49.522690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1378/2764] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:46:49.527526 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd001b-1b0e-4a24-bca2-e013ed540b6d admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:49.537873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd001b-1b0e-4a24-bca2-e013ed540b6d admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:49.542471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae14e9-5758-4451-ad3a-947844fdc892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:49.543334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae14e9-5758-4451-ad3a-947844fdc892 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.543705 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae14e9-5758-4451-ad3a-947844fdc892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.543987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae14e9-5758-4451-ad3a-947844fdc892 admin admin] PATH_INFO: `/v3/projects/164248cb1c70429aa5eb99f4c69330d2/users/3baa8c69b5254cb2a3f9c8ebce4643a3/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.557868 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae14e9-5758-4451-ad3a-947844fdc892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=164248cb1c70429aa5eb99f4c69330d2, user_id=3baa8c69b5254cb2a3f9c8ebce4643a3, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:49.560528 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae14e9-5758-4451-ad3a-947844fdc892 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:49.573427 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1387/2765] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:46:49 2022] PUT /identity/v3/projects/164248cb1c70429aa5eb99f4c69330d2/users/3baa8c69b5254cb2a3f9c8ebce4643a3/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:46:49.583771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593ba3-5c84-479c-861d-b189414da1b9 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.584060 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593ba3-5c84-479c-861d-b189414da1b9 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.584334 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593ba3-5c84-479c-861d-b189414da1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.609591 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-b3593ba3-5c84-479c-861d-b189414da1b9 None None] MFA Rules not processed for user `3baa8c69b5254cb2a3f9c8ebce4643a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:46:49.610831 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b3593ba3-5c84-479c-861d-b189414da1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:49.673031 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1379/2766] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:46:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:46:49.677439 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae14e9-5758-4451-ad3a-947844fdc892 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:49.737326 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae14e9-5758-4451-ad3a-947844fdc892 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:49.741985 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af653ef5-fa00-4d03-9d7f-f37d2d65e6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:49.742682 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af653ef5-fa00-4d03-9d7f-f37d2d65e6eb admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.742966 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af653ef5-fa00-4d03-9d7f-f37d2d65e6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.743244 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af653ef5-fa00-4d03-9d7f-f37d2d65e6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.743936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af653ef5-fa00-4d03-9d7f-f37d2d65e6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:49.745828 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af653ef5-fa00-4d03-9d7f-f37d2d65e6eb admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:49.771008 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1388/2767] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:46:49 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:46:49.775198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593ba3-5c84-479c-861d-b189414da1b9 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:49.785704 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593ba3-5c84-479c-861d-b189414da1b9 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:49.840235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29709682-f594-42a0-81df-3cf127e55102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:49.840968 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29709682-f594-42a0-81df-3cf127e55102 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.841255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29709682-f594-42a0-81df-3cf127e55102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.841531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29709682-f594-42a0-81df-3cf127e55102 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.842258 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29709682-f594-42a0-81df-3cf127e55102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:49.844167 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29709682-f594-42a0-81df-3cf127e55102 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:49.864453 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1380/2768] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:46:49 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:46:49.868419 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af653ef5-fa00-4d03-9d7f-f37d2d65e6eb admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:49.879305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af653ef5-fa00-4d03-9d7f-f37d2d65e6eb admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:49.883894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9292b-d204-4307-99dc-ee5d2240af58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:49.884540 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9292b-d204-4307-99dc-ee5d2240af58 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.884820 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9292b-d204-4307-99dc-ee5d2240af58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.885094 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9292b-d204-4307-99dc-ee5d2240af58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.885817 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9292b-d204-4307-99dc-ee5d2240af58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:49.887447 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9292b-d204-4307-99dc-ee5d2240af58 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:49.898553 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1389/2769] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:46:49.902310 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29709682-f594-42a0-81df-3cf127e55102 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:49.912413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29709682-f594-42a0-81df-3cf127e55102 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:49.916899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbd2c9-2ae2-4ee9-8413-4125357dc243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:49.917760 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbd2c9-2ae2-4ee9-8413-4125357dc243 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:49.918039 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbd2c9-2ae2-4ee9-8413-4125357dc243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:49.918349 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbd2c9-2ae2-4ee9-8413-4125357dc243 admin admin] PATH_INFO: `/v3/projects/91f491509cbc42cca25db9ef9c6581e4/users/70d660a5a0984488968dacebb5faf630/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:49.932815 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbd2c9-2ae2-4ee9-8413-4125357dc243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f491509cbc42cca25db9ef9c6581e4, user_id=70d660a5a0984488968dacebb5faf630, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:49.935583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbd2c9-2ae2-4ee9-8413-4125357dc243 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:49.948565 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1381/2770] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:46:49 2022] PUT /identity/v3/projects/91f491509cbc42cca25db9ef9c6581e4/users/70d660a5a0984488968dacebb5faf630/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:46:49.952491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9292b-d204-4307-99dc-ee5d2240af58 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:49.962283 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9292b-d204-4307-99dc-ee5d2240af58 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:50.018786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70dcdb0-dee0-4fca-8838-373b5da3eb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:50.019480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dcdb0-dee0-4fca-8838-373b5da3eb1d admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:50.019768 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dcdb0-dee0-4fca-8838-373b5da3eb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:50.020046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dcdb0-dee0-4fca-8838-373b5da3eb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:50.020773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70dcdb0-dee0-4fca-8838-373b5da3eb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:50.022444 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70dcdb0-dee0-4fca-8838-373b5da3eb1d admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:50.032157 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1390/2771] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:46:50.036275 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbd2c9-2ae2-4ee9-8413-4125357dc243 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:50.046646 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbd2c9-2ae2-4ee9-8413-4125357dc243 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:50.051747 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64a0ee-cf81-4f33-a78a-3d6317cae6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:50.052630 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64a0ee-cf81-4f33-a78a-3d6317cae6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:50.052911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64a0ee-cf81-4f33-a78a-3d6317cae6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:50.053183 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64a0ee-cf81-4f33-a78a-3d6317cae6ad admin admin] PATH_INFO: `/v3/projects/91f491509cbc42cca25db9ef9c6581e4/users/70d660a5a0984488968dacebb5faf630/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:50.055159 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64a0ee-cf81-4f33-a78a-3d6317cae6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f491509cbc42cca25db9ef9c6581e4, user_id=70d660a5a0984488968dacebb5faf630, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:50.057782 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64a0ee-cf81-4f33-a78a-3d6317cae6ad admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:50.068496 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1382/2772] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:46:50 2022] PUT /identity/v3/projects/91f491509cbc42cca25db9ef9c6581e4/users/70d660a5a0984488968dacebb5faf630/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:46:50.078442 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c44cba-834f-45d2-891f-f61578e9d2c9 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:50.078735 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c44cba-834f-45d2-891f-f61578e9d2c9 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:50.079016 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c44cba-834f-45d2-891f-f61578e9d2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:50.104945 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-f3c44cba-834f-45d2-891f-f61578e9d2c9 None None] MFA Rules not processed for user `70d660a5a0984488968dacebb5faf630`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:46:50.106127 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f3c44cba-834f-45d2-891f-f61578e9d2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:50.170138 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1391/2773] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:46:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:46:50.180579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64a0ee-cf81-4f33-a78a-3d6317cae6ad admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:50.182315 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2e64a0ee-cf81-4f33-a78a-3d6317cae6ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:50.236030 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64a0ee-cf81-4f33-a78a-3d6317cae6ad admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:50.239852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce1008-69fe-4039-8a3d-a8784d8e0fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:50.240479 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce1008-69fe-4039-8a3d-a8784d8e0fca service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:50.240764 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce1008-69fe-4039-8a3d-a8784d8e0fca service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:50.241040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce1008-69fe-4039-8a3d-a8784d8e0fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:50.249759 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce1008-69fe-4039-8a3d-a8784d8e0fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:50.251840 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce1008-69fe-4039-8a3d-a8784d8e0fca service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:50.260878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1383/2774] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:46:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:46:50.328302 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c44cba-834f-45d2-891f-f61578e9d2c9 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:50.337585 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c44cba-834f-45d2-891f-f61578e9d2c9 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:50.341199 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4fd12-8eac-4830-b81c-031d51aafb87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:50.341833 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4fd12-8eac-4830-b81c-031d51aafb87 service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:50.342118 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4fd12-8eac-4830-b81c-031d51aafb87 service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:50.342429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4fd12-8eac-4830-b81c-031d51aafb87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:50.396621 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4fd12-8eac-4830-b81c-031d51aafb87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:50.398052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4fd12-8eac-4830-b81c-031d51aafb87 service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:50.407425 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1392/2775] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:46:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:27.975459 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce1008-69fe-4039-8a3d-a8784d8e0fca service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:28.033640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce1008-69fe-4039-8a3d-a8784d8e0fca service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:28.037973 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:28.038852 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:28.039131 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:28.039401 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] PATH_INFO: `/v3/users/3baa8c69b5254cb2a3f9c8ebce4643a3` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:28.040556 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3baa8c69b5254cb2a3f9c8ebce4643a3)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:28.042511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:28.091801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3baa8c69b5254cb2a3f9c8ebce4643a3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.096917 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3baa8c69b5254cb2a3f9c8ebce4643a3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.108226 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3baa8c69b5254cb2a3f9c8ebce4643a3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.108912 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3baa8c69b5254cb2a3f9c8ebce4643a3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.109515 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3baa8c69b5254cb2a3f9c8ebce4643a3'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.122498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1384/2776] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:27 2022] DELETE /identity/v3/users/3baa8c69b5254cb2a3f9c8ebce4643a3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:28.126899 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee5479-eb79-4e55-9512-75a29fdc3680 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:28.127374 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee5479-eb79-4e55-9512-75a29fdc3680 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:28.127479 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee5479-eb79-4e55-9512-75a29fdc3680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:28.144622 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-dfee5479-eb79-4e55-9512-75a29fdc3680 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:28.145796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-dfee5479-eb79-4e55-9512-75a29fdc3680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:28.201311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1393/2777] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:28.211457 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:28.212813 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:28.265585 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554d43f-0256-408e-a7f4-fe19e07b35cf admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:28.269692 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4034d7e-d617-44af-bd00-93496c396061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:28.270360 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4034d7e-d617-44af-bd00-93496c396061 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:28.270642 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4034d7e-d617-44af-bd00-93496c396061 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:28.270911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4034d7e-d617-44af-bd00-93496c396061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:28.279918 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4034d7e-d617-44af-bd00-93496c396061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:28.281323 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4034d7e-d617-44af-bd00-93496c396061 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:28.291074 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1385/2778] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:28.545452 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee5479-eb79-4e55-9512-75a29fdc3680 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:28.546895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-dfee5479-eb79-4e55-9512-75a29fdc3680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:28.558196 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee5479-eb79-4e55-9512-75a29fdc3680 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:28.563347 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:28.564187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:28.564576 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:28.564719 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] PATH_INFO: `/v3/projects/164248cb1c70429aa5eb99f4c69330d2` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:28.565876 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=164248cb1c70429aa5eb99f4c69330d2)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:28.567796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:28.611901 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '164248cb1c70429aa5eb99f4c69330d2', 'request_id': 'req-c9a0810a-ca88-4af7-925e-0abf0cba0532'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.616973 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '164248cb1c70429aa5eb99f4c69330d2', 'request_id': 'req-c9a0810a-ca88-4af7-925e-0abf0cba0532'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.623863 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '164248cb1c70429aa5eb99f4c69330d2', 'request_id': 'req-c9a0810a-ca88-4af7-925e-0abf0cba0532'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.635090 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] The token cache is being invalidate because project 164248cb1c70429aa5eb99f4c69330d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:28.635372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.635995 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.637495 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1394/2779] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:28 2022] DELETE /identity/v3/projects/164248cb1c70429aa5eb99f4c69330d2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:28.642106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4034d7e-d617-44af-bd00-93496c396061 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:28.651459 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4034d7e-d617-44af-bd00-93496c396061 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:28.706064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e890b-5fce-48dc-a254-8332e686a466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:28.706957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e890b-5fce-48dc-a254-8332e686a466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:28.707240 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e890b-5fce-48dc-a254-8332e686a466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:28.707517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e890b-5fce-48dc-a254-8332e686a466 admin admin] PATH_INFO: `/v3/users/70d660a5a0984488968dacebb5faf630` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:28.708694 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e890b-5fce-48dc-a254-8332e686a466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d660a5a0984488968dacebb5faf630)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:28.710640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e890b-5fce-48dc-a254-8332e686a466 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:28.755605 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d63e890b-5fce-48dc-a254-8332e686a466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d660a5a0984488968dacebb5faf630'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.762032 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d63e890b-5fce-48dc-a254-8332e686a466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d660a5a0984488968dacebb5faf630'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.773394 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d63e890b-5fce-48dc-a254-8332e686a466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d660a5a0984488968dacebb5faf630'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.774063 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d63e890b-5fce-48dc-a254-8332e686a466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d660a5a0984488968dacebb5faf630'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.774719 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d63e890b-5fce-48dc-a254-8332e686a466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d660a5a0984488968dacebb5faf630'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:28.788957 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1386/2780] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:28 2022] DELETE /identity/v3/users/70d660a5a0984488968dacebb5faf630 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:29.049215 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.050757 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:29.064443 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0810a-ca88-4af7-925e-0abf0cba0532 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:29.121686 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:29.122587 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.122876 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.123149 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9 admin admin] PATH_INFO: `/v3/projects/91f491509cbc42cca25db9ef9c6581e4` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.124307 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f491509cbc42cca25db9ef9c6581e4)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:29.126190 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:29.172537 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f491509cbc42cca25db9ef9c6581e4', 'request_id': 'req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:29.177634 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f491509cbc42cca25db9ef9c6581e4', 'request_id': 'req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:29.184753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f491509cbc42cca25db9ef9c6581e4', 'request_id': 'req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:29.195431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9 admin admin] The token cache is being invalidate because project 91f491509cbc42cca25db9ef9c6581e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:29.195710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:29.196323 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a5625df9-cda0-483a-a4fd-9c8854cdc0e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:29.197817 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1395/2781] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:29 2022] DELETE /identity/v3/projects/91f491509cbc42cca25db9ef9c6581e4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:29.202773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77acb1d-e859-47b6-80ae-dea3b2615f74 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.203247 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77acb1d-e859-47b6-80ae-dea3b2615f74 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.203357 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77acb1d-e859-47b6-80ae-dea3b2615f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.221715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-f77acb1d-e859-47b6-80ae-dea3b2615f74 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:29.222915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-f77acb1d-e859-47b6-80ae-dea3b2615f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:29.278522 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1387/2782] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:29.286494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ff91b-cb40-4701-8514-e6dd2172bd52 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.286873 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ff91b-cb40-4701-8514-e6dd2172bd52 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.287266 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ff91b-cb40-4701-8514-e6dd2172bd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.305582 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-055ff91b-cb40-4701-8514-e6dd2172bd52 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:29.306710 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-055ff91b-cb40-4701-8514-e6dd2172bd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:29.314844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1396/2783] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:29.318767 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77acb1d-e859-47b6-80ae-dea3b2615f74 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.328212 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77acb1d-e859-47b6-80ae-dea3b2615f74 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:29.333461 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59097c-7427-4735-9f73-ae2938f0e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:29.334106 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59097c-7427-4735-9f73-ae2938f0e041 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.334410 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59097c-7427-4735-9f73-ae2938f0e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.334686 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59097c-7427-4735-9f73-ae2938f0e041 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.335402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59097c-7427-4735-9f73-ae2938f0e041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:47:29.335708 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59097c-7427-4735-9f73-ae2938f0e041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:29.337286 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59097c-7427-4735-9f73-ae2938f0e041 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:29.348329 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1388/2784] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:47:29.352431 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ff91b-cb40-4701-8514-e6dd2172bd52 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.361669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ff91b-cb40-4701-8514-e6dd2172bd52 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:29.366187 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f745f-e24d-4c1a-8a4f-15d263229d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:29.366845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f745f-e24d-4c1a-8a4f-15d263229d15 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.367122 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f745f-e24d-4c1a-8a4f-15d263229d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.367391 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f745f-e24d-4c1a-8a4f-15d263229d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.368067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f745f-e24d-4c1a-8a4f-15d263229d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:29.369917 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f745f-e24d-4c1a-8a4f-15d263229d15 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:29.394658 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1397/2785] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:29 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:29.398746 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59097c-7427-4735-9f73-ae2938f0e041 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.408379 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59097c-7427-4735-9f73-ae2938f0e041 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:29.461242 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d14487-9b6a-4f49-bdea-c7de6e5df7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:29.461892 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d14487-9b6a-4f49-bdea-c7de6e5df7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.462173 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d14487-9b6a-4f49-bdea-c7de6e5df7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.462476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d14487-9b6a-4f49-bdea-c7de6e5df7e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.463161 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d14487-9b6a-4f49-bdea-c7de6e5df7e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:29.465253 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d14487-9b6a-4f49-bdea-c7de6e5df7e3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:29.484319 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1389/2786] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:29 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:29.488460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f745f-e24d-4c1a-8a4f-15d263229d15 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.498460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f745f-e24d-4c1a-8a4f-15d263229d15 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:29.503541 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0d451-1179-4c57-9834-9be5a6530ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:29.504184 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d451-1179-4c57-9834-9be5a6530ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.504553 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d451-1179-4c57-9834-9be5a6530ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.504830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d451-1179-4c57-9834-9be5a6530ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.505551 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0d451-1179-4c57-9834-9be5a6530ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:29.507164 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0d451-1179-4c57-9834-9be5a6530ca5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:29.518975 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1398/2787] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:29.523062 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d14487-9b6a-4f49-bdea-c7de6e5df7e3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.536509 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d14487-9b6a-4f49-bdea-c7de6e5df7e3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:29.541192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e3922-6705-4762-b1c3-d0148be13ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:29.541845 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e3922-6705-4762-b1c3-d0148be13ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.542129 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e3922-6705-4762-b1c3-d0148be13ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.542467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e3922-6705-4762-b1c3-d0148be13ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.543170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e3922-6705-4762-b1c3-d0148be13ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:29.544758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e3922-6705-4762-b1c3-d0148be13ad1 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:29.554773 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1390/2788] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:47:29.558979 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0d451-1179-4c57-9834-9be5a6530ca5 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.569313 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0d451-1179-4c57-9834-9be5a6530ca5 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:29.573848 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e734c8-4f50-4c5c-ad2a-babdab777259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:29.574747 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e734c8-4f50-4c5c-ad2a-babdab777259 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.575029 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e734c8-4f50-4c5c-ad2a-babdab777259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.575299 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e734c8-4f50-4c5c-ad2a-babdab777259 admin admin] PATH_INFO: `/v3/projects/1f62ca867d124571b87720d44bf935e6/users/2b571bc01b1a42be916718f6b7534892/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.589831 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e734c8-4f50-4c5c-ad2a-babdab777259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f62ca867d124571b87720d44bf935e6, user_id=2b571bc01b1a42be916718f6b7534892, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:29.592482 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e734c8-4f50-4c5c-ad2a-babdab777259 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:29.604589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1399/2789] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:29 2022] PUT /identity/v3/projects/1f62ca867d124571b87720d44bf935e6/users/2b571bc01b1a42be916718f6b7534892/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:29.615467 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862801a-1537-4d60-a605-9145814f2195 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.615758 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862801a-1537-4d60-a605-9145814f2195 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.616037 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862801a-1537-4d60-a605-9145814f2195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.641638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-2862801a-1537-4d60-a605-9145814f2195 None None] MFA Rules not processed for user `2b571bc01b1a42be916718f6b7534892`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:29.642863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-2862801a-1537-4d60-a605-9145814f2195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:29.704501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1391/2790] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:29.709027 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e734c8-4f50-4c5c-ad2a-babdab777259 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.769580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e734c8-4f50-4c5c-ad2a-babdab777259 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:29.774608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc16766-54b3-48cd-83fa-5891af382009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:29.775261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc16766-54b3-48cd-83fa-5891af382009 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.775546 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc16766-54b3-48cd-83fa-5891af382009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.775824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc16766-54b3-48cd-83fa-5891af382009 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.776503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc16766-54b3-48cd-83fa-5891af382009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:29.778421 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc16766-54b3-48cd-83fa-5891af382009 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:29.803080 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1400/2791] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:29 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:29.807099 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862801a-1537-4d60-a605-9145814f2195 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.817994 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862801a-1537-4d60-a605-9145814f2195 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:29.870364 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426b7a-0038-420d-9e16-abefc84ad073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:29.871025 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426b7a-0038-420d-9e16-abefc84ad073 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.871381 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426b7a-0038-420d-9e16-abefc84ad073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.871731 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426b7a-0038-420d-9e16-abefc84ad073 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.872494 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af426b7a-0038-420d-9e16-abefc84ad073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:29.874442 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af426b7a-0038-420d-9e16-abefc84ad073 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:29.894096 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1392/2792] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:29 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:29.898032 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc16766-54b3-48cd-83fa-5891af382009 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.908028 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc16766-54b3-48cd-83fa-5891af382009 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:29.912529 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0251d5-dee6-4d6b-bf97-750fab58b745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:29.913172 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0251d5-dee6-4d6b-bf97-750fab58b745 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.913456 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0251d5-dee6-4d6b-bf97-750fab58b745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.913730 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0251d5-dee6-4d6b-bf97-750fab58b745 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.914505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0251d5-dee6-4d6b-bf97-750fab58b745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:29.916090 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0251d5-dee6-4d6b-bf97-750fab58b745 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:29.926805 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1401/2793] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:29.930681 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426b7a-0038-420d-9e16-abefc84ad073 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.940798 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426b7a-0038-420d-9e16-abefc84ad073 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:29.945373 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f233972-0191-4ad0-8a91-deb97c5406d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:29.946256 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f233972-0191-4ad0-8a91-deb97c5406d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.946540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f233972-0191-4ad0-8a91-deb97c5406d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.946814 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f233972-0191-4ad0-8a91-deb97c5406d6 admin admin] PATH_INFO: `/v3/projects/1542a790191a44cdb240ad3d518e4389/users/a3193668639f4742b4e515c03c0c5cf8/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.960531 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f233972-0191-4ad0-8a91-deb97c5406d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1542a790191a44cdb240ad3d518e4389, user_id=a3193668639f4742b4e515c03c0c5cf8, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:29.963182 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f233972-0191-4ad0-8a91-deb97c5406d6 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:29.975374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1393/2794] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:29 2022] PUT /identity/v3/projects/1542a790191a44cdb240ad3d518e4389/users/a3193668639f4742b4e515c03c0c5cf8/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:29.979305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0251d5-dee6-4d6b-bf97-750fab58b745 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.989951 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0251d5-dee6-4d6b-bf97-750fab58b745 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:30.043400 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163031b-157e-444e-aad6-adfd7e9c999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:30.044053 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163031b-157e-444e-aad6-adfd7e9c999e admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:30.044960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163031b-157e-444e-aad6-adfd7e9c999e admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:30.044960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163031b-157e-444e-aad6-adfd7e9c999e admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:30.045417 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163031b-157e-444e-aad6-adfd7e9c999e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:30.046923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163031b-157e-444e-aad6-adfd7e9c999e admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:30.057043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1402/2795] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:30.061638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f233972-0191-4ad0-8a91-deb97c5406d6 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:30.072384 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f233972-0191-4ad0-8a91-deb97c5406d6 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:30.076540 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1dbb7-84d6-439e-8f9b-49299198d304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:30.077413 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1dbb7-84d6-439e-8f9b-49299198d304 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:30.077690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1dbb7-84d6-439e-8f9b-49299198d304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:30.077971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1dbb7-84d6-439e-8f9b-49299198d304 admin admin] PATH_INFO: `/v3/projects/1542a790191a44cdb240ad3d518e4389/users/a3193668639f4742b4e515c03c0c5cf8/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:30.079925 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1dbb7-84d6-439e-8f9b-49299198d304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1542a790191a44cdb240ad3d518e4389, user_id=a3193668639f4742b4e515c03c0c5cf8, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:30.082579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1dbb7-84d6-439e-8f9b-49299198d304 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:30.093069 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1394/2796] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:30 2022] PUT /identity/v3/projects/1542a790191a44cdb240ad3d518e4389/users/a3193668639f4742b4e515c03c0c5cf8/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:30.104292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b892c-5899-4687-b361-20c368f1eec6 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:30.104581 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b892c-5899-4687-b361-20c368f1eec6 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:30.104862 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b892c-5899-4687-b361-20c368f1eec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:30.131033 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-583b892c-5899-4687-b361-20c368f1eec6 None None] MFA Rules not processed for user `a3193668639f4742b4e515c03c0c5cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:30.132212 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-583b892c-5899-4687-b361-20c368f1eec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:30.197077 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1403/2797] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:30.207058 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1dbb7-84d6-439e-8f9b-49299198d304 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:30.208774 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c2d1dbb7-84d6-439e-8f9b-49299198d304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:30.263124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1dbb7-84d6-439e-8f9b-49299198d304 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:30.266979 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010cbb2-67c7-4f34-9d6a-6c1c1f1a6c8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:30.267618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010cbb2-67c7-4f34-9d6a-6c1c1f1a6c8a service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:30.267900 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010cbb2-67c7-4f34-9d6a-6c1c1f1a6c8a service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:30.268175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010cbb2-67c7-4f34-9d6a-6c1c1f1a6c8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:30.277193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010cbb2-67c7-4f34-9d6a-6c1c1f1a6c8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:30.278653 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010cbb2-67c7-4f34-9d6a-6c1c1f1a6c8a service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:30.288300 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1395/2798] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:30.624363 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b892c-5899-4687-b361-20c368f1eec6 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:30.685468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b892c-5899-4687-b361-20c368f1eec6 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:30.690542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:30.691398 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:30.691677 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:30.691950 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] PATH_INFO: `/v3/users/2b571bc01b1a42be916718f6b7534892` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:30.693123 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b571bc01b1a42be916718f6b7534892)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:30.695052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:30.738310 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b571bc01b1a42be916718f6b7534892'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.744593 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b571bc01b1a42be916718f6b7534892'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.756584 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b571bc01b1a42be916718f6b7534892'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.757228 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b571bc01b1a42be916718f6b7534892'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.763786 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b571bc01b1a42be916718f6b7534892'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.769948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1404/2799] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:30 2022] DELETE /identity/v3/users/2b571bc01b1a42be916718f6b7534892 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:30.774684 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dac2cf-e314-4c23-a228-810a796bf11a None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:30.774971 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dac2cf-e314-4c23-a228-810a796bf11a None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:30.775277 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dac2cf-e314-4c23-a228-810a796bf11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:30.794012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-b2dac2cf-e314-4c23-a228-810a796bf11a None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:30.795222 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b2dac2cf-e314-4c23-a228-810a796bf11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:30.849229 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1396/2800] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:30.858772 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:30.860702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:30.915465 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ea5f7-6435-4e4f-b914-7a02830ecbe8 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:30.919094 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edfb45-c1f2-4c7b-9fa9-6fa5b0dacbab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:30.919731 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edfb45-c1f2-4c7b-9fa9-6fa5b0dacbab service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:30.920014 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edfb45-c1f2-4c7b-9fa9-6fa5b0dacbab service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:30.920288 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edfb45-c1f2-4c7b-9fa9-6fa5b0dacbab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:30.929689 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edfb45-c1f2-4c7b-9fa9-6fa5b0dacbab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:30.931145 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edfb45-c1f2-4c7b-9fa9-6fa5b0dacbab service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:30.940265 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1405/2801] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:31.188807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dac2cf-e314-4c23-a228-810a796bf11a None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:31.190366 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-b2dac2cf-e314-4c23-a228-810a796bf11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:31.202054 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dac2cf-e314-4c23-a228-810a796bf11a None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:31.207195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:31.208142 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:31.208492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:31.208865 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] PATH_INFO: `/v3/projects/1f62ca867d124571b87720d44bf935e6` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:31.210118 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f62ca867d124571b87720d44bf935e6)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:31.212049 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:31.255836 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f62ca867d124571b87720d44bf935e6', 'request_id': 'req-489952ec-a2ab-4cec-8048-9834b5e3f330'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.261545 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f62ca867d124571b87720d44bf935e6', 'request_id': 'req-489952ec-a2ab-4cec-8048-9834b5e3f330'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.268663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f62ca867d124571b87720d44bf935e6', 'request_id': 'req-489952ec-a2ab-4cec-8048-9834b5e3f330'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.278506 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] The token cache is being invalidate because project 1f62ca867d124571b87720d44bf935e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:31.278788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.279393 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.280905 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1397/2802] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:31 2022] DELETE /identity/v3/projects/1f62ca867d124571b87720d44bf935e6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:31.285394 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edfb45-c1f2-4c7b-9fa9-6fa5b0dacbab service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:31.294782 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edfb45-c1f2-4c7b-9fa9-6fa5b0dacbab service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:31.348159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a7a91-3125-4adf-9c33-fd377d810221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:31.349009 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a7a91-3125-4adf-9c33-fd377d810221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:31.349288 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a7a91-3125-4adf-9c33-fd377d810221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:31.349559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a7a91-3125-4adf-9c33-fd377d810221 admin admin] PATH_INFO: `/v3/users/a3193668639f4742b4e515c03c0c5cf8` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:31.350740 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a7a91-3125-4adf-9c33-fd377d810221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3193668639f4742b4e515c03c0c5cf8)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:31.352624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a7a91-3125-4adf-9c33-fd377d810221 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:31.395733 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-645a7a91-3125-4adf-9c33-fd377d810221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3193668639f4742b4e515c03c0c5cf8'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.402487 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-645a7a91-3125-4adf-9c33-fd377d810221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3193668639f4742b4e515c03c0c5cf8'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.414109 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-645a7a91-3125-4adf-9c33-fd377d810221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3193668639f4742b4e515c03c0c5cf8'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.414754 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-645a7a91-3125-4adf-9c33-fd377d810221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3193668639f4742b4e515c03c0c5cf8'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.421213 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-645a7a91-3125-4adf-9c33-fd377d810221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3193668639f4742b4e515c03c0c5cf8'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.426993 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1406/2803] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:31 2022] DELETE /identity/v3/users/a3193668639f4742b4e515c03c0c5cf8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:31.684713 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:31.686272 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:31.699962 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489952ec-a2ab-4cec-8048-9834b5e3f330 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:31.755244 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9594a06-490b-4a6b-b69b-1b65cacf58c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:31.756090 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9594a06-490b-4a6b-b69b-1b65cacf58c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:31.756370 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9594a06-490b-4a6b-b69b-1b65cacf58c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:31.756640 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9594a06-490b-4a6b-b69b-1b65cacf58c7 admin admin] PATH_INFO: `/v3/projects/1542a790191a44cdb240ad3d518e4389` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:31.757788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9594a06-490b-4a6b-b69b-1b65cacf58c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1542a790191a44cdb240ad3d518e4389)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:31.759712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9594a06-490b-4a6b-b69b-1b65cacf58c7 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:31.801354 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d9594a06-490b-4a6b-b69b-1b65cacf58c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1542a790191a44cdb240ad3d518e4389', 'request_id': 'req-d9594a06-490b-4a6b-b69b-1b65cacf58c7'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.807014 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d9594a06-490b-4a6b-b69b-1b65cacf58c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1542a790191a44cdb240ad3d518e4389', 'request_id': 'req-d9594a06-490b-4a6b-b69b-1b65cacf58c7'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.814434 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d9594a06-490b-4a6b-b69b-1b65cacf58c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1542a790191a44cdb240ad3d518e4389', 'request_id': 'req-d9594a06-490b-4a6b-b69b-1b65cacf58c7'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.824460 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d9594a06-490b-4a6b-b69b-1b65cacf58c7 admin admin] The token cache is being invalidate because project 1542a790191a44cdb240ad3d518e4389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:31.824741 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d9594a06-490b-4a6b-b69b-1b65cacf58c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.825377 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-d9594a06-490b-4a6b-b69b-1b65cacf58c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.826886 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1398/2804] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:31 2022] DELETE /identity/v3/projects/1542a790191a44cdb240ad3d518e4389 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:31.832289 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127a673-dcbc-437e-8824-78472774f87b None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:31.832573 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127a673-dcbc-437e-8824-78472774f87b None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:31.832844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127a673-dcbc-437e-8824-78472774f87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:31.849632 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-d127a673-dcbc-437e-8824-78472774f87b None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:31.850824 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-d127a673-dcbc-437e-8824-78472774f87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:31.906488 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1407/2805] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:31.914156 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a7867-a4a8-4a1a-b1cd-3318f0fa84f1 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:31.914472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a7867-a4a8-4a1a-b1cd-3318f0fa84f1 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:31.914744 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a7867-a4a8-4a1a-b1cd-3318f0fa84f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:31.932982 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-df2a7867-a4a8-4a1a-b1cd-3318f0fa84f1 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:31.934073 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-df2a7867-a4a8-4a1a-b1cd-3318f0fa84f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:31.942648 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1399/2806] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:47:31.946895 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127a673-dcbc-437e-8824-78472774f87b None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:31.956179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127a673-dcbc-437e-8824-78472774f87b None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:31.960749 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6675714-addd-4e25-a1bd-ce6259b0b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:31.961413 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6675714-addd-4e25-a1bd-ce6259b0b8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:31.961692 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6675714-addd-4e25-a1bd-ce6259b0b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:31.961963 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6675714-addd-4e25-a1bd-ce6259b0b8e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:31.962712 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6675714-addd-4e25-a1bd-ce6259b0b8e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:47:31.963013 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6675714-addd-4e25-a1bd-ce6259b0b8e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:31.964597 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6675714-addd-4e25-a1bd-ce6259b0b8e3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:31.976015 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1408/2807] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:47:31.980485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a7867-a4a8-4a1a-b1cd-3318f0fa84f1 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:31.990183 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a7867-a4a8-4a1a-b1cd-3318f0fa84f1 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:31.994807 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0785f8-b7e5-46ed-ad37-1884c2cb4aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:31.995476 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0785f8-b7e5-46ed-ad37-1884c2cb4aef admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:31.995755 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0785f8-b7e5-46ed-ad37-1884c2cb4aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:31.996025 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0785f8-b7e5-46ed-ad37-1884c2cb4aef admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:31.996715 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0785f8-b7e5-46ed-ad37-1884c2cb4aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:31.998632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0785f8-b7e5-46ed-ad37-1884c2cb4aef admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.022949 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1400/2808] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:31 2022] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:32.027100 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6675714-addd-4e25-a1bd-ce6259b0b8e3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.036702 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6675714-addd-4e25-a1bd-ce6259b0b8e3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.091920 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e596-f155-42b1-aa3c-c21531894d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.092627 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e596-f155-42b1-aa3c-c21531894d8c admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.092908 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e596-f155-42b1-aa3c-c21531894d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.093178 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e596-f155-42b1-aa3c-c21531894d8c admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.094284 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12e596-f155-42b1-aa3c-c21531894d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.095941 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12e596-f155-42b1-aa3c-c21531894d8c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.115525 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1409/2809] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:32 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:32.119835 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0785f8-b7e5-46ed-ad37-1884c2cb4aef admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.130455 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0785f8-b7e5-46ed-ad37-1884c2cb4aef admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.134991 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b59829-dd58-4bf3-8318-52945b7a2f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.135639 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59829-dd58-4bf3-8318-52945b7a2f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.135920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59829-dd58-4bf3-8318-52945b7a2f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.136192 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59829-dd58-4bf3-8318-52945b7a2f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.136911 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b59829-dd58-4bf3-8318-52945b7a2f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.138537 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b59829-dd58-4bf3-8318-52945b7a2f23 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.148535 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1401/2810] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:32.152345 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e596-f155-42b1-aa3c-c21531894d8c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.161773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e596-f155-42b1-aa3c-c21531894d8c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.166292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca04519-172a-456c-84e0-1f2c2ee47408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.166955 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca04519-172a-456c-84e0-1f2c2ee47408 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.167232 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca04519-172a-456c-84e0-1f2c2ee47408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.167503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca04519-172a-456c-84e0-1f2c2ee47408 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.168216 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca04519-172a-456c-84e0-1f2c2ee47408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.169971 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca04519-172a-456c-84e0-1f2c2ee47408 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.180231 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1410/2811] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:32.184285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b59829-dd58-4bf3-8318-52945b7a2f23 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.194472 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b59829-dd58-4bf3-8318-52945b7a2f23 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.198980 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81457bf2-108c-4237-9e9e-c8a155b570a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.199855 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457bf2-108c-4237-9e9e-c8a155b570a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.200133 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457bf2-108c-4237-9e9e-c8a155b570a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.200403 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457bf2-108c-4237-9e9e-c8a155b570a3 admin admin] PATH_INFO: `/v3/projects/e1e5c66c50ca40ca9db6a9549cab3c19/users/4de0abd2378f462c98d8916e2d513ac6/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.214497 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81457bf2-108c-4237-9e9e-c8a155b570a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e5c66c50ca40ca9db6a9549cab3c19, user_id=4de0abd2378f462c98d8916e2d513ac6, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.217175 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81457bf2-108c-4237-9e9e-c8a155b570a3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.229504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1402/2812] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:32 2022] PUT /identity/v3/projects/e1e5c66c50ca40ca9db6a9549cab3c19/users/4de0abd2378f462c98d8916e2d513ac6/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:32.241106 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccacb8-c285-4a1b-b1a1-b0826b6783d7 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.241416 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccacb8-c285-4a1b-b1a1-b0826b6783d7 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.241688 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccacb8-c285-4a1b-b1a1-b0826b6783d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.267601 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-03ccacb8-c285-4a1b-b1a1-b0826b6783d7 None None] MFA Rules not processed for user `4de0abd2378f462c98d8916e2d513ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:32.268812 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-03ccacb8-c285-4a1b-b1a1-b0826b6783d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:32.329607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1411/2813] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:32.333983 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81457bf2-108c-4237-9e9e-c8a155b570a3 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.391993 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81457bf2-108c-4237-9e9e-c8a155b570a3 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.396579 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed888d-724e-4500-afcb-edeb5747d17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.397220 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed888d-724e-4500-afcb-edeb5747d17d admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.397500 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed888d-724e-4500-afcb-edeb5747d17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.397774 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed888d-724e-4500-afcb-edeb5747d17d admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.398492 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed888d-724e-4500-afcb-edeb5747d17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.400407 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed888d-724e-4500-afcb-edeb5747d17d admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.425892 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1403/2814] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:32 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:32.429887 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccacb8-c285-4a1b-b1a1-b0826b6783d7 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.440468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccacb8-c285-4a1b-b1a1-b0826b6783d7 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.496086 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a812a-eb64-4e6b-aebd-44ee1298e341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.496739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a812a-eb64-4e6b-aebd-44ee1298e341 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.497020 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a812a-eb64-4e6b-aebd-44ee1298e341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.497290 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a812a-eb64-4e6b-aebd-44ee1298e341 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.497972 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a812a-eb64-4e6b-aebd-44ee1298e341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.499894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a812a-eb64-4e6b-aebd-44ee1298e341 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.518285 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1412/2815] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:32 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:32.522249 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed888d-724e-4500-afcb-edeb5747d17d admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.532727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed888d-724e-4500-afcb-edeb5747d17d admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.537336 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b965106-8bea-4dd0-b610-be55f0b9450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.537985 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b965106-8bea-4dd0-b610-be55f0b9450b admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.538306 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b965106-8bea-4dd0-b610-be55f0b9450b admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.538588 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b965106-8bea-4dd0-b610-be55f0b9450b admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.539317 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b965106-8bea-4dd0-b610-be55f0b9450b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.540885 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b965106-8bea-4dd0-b610-be55f0b9450b admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.551611 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1404/2816] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:32.555368 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a812a-eb64-4e6b-aebd-44ee1298e341 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.565132 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a812a-eb64-4e6b-aebd-44ee1298e341 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.569800 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1372fc-7151-4fbd-9631-b913919b372b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.570739 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1372fc-7151-4fbd-9631-b913919b372b admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.571046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1372fc-7151-4fbd-9631-b913919b372b admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.571322 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1372fc-7151-4fbd-9631-b913919b372b admin admin] PATH_INFO: `/v3/projects/3f89ca4e79d8413b820efcee5a67f105/users/0dab863ca6af4b179e671c5dc92ad62a/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.585897 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1372fc-7151-4fbd-9631-b913919b372b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f89ca4e79d8413b820efcee5a67f105, user_id=0dab863ca6af4b179e671c5dc92ad62a, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.588583 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1372fc-7151-4fbd-9631-b913919b372b admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.601520 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1413/2817] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:32 2022] PUT /identity/v3/projects/3f89ca4e79d8413b820efcee5a67f105/users/0dab863ca6af4b179e671c5dc92ad62a/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:32.605394 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b965106-8bea-4dd0-b610-be55f0b9450b admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.615830 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b965106-8bea-4dd0-b610-be55f0b9450b admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.671041 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749018f0-15b0-475e-b484-c172fe532d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.671706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749018f0-15b0-475e-b484-c172fe532d95 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.671986 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749018f0-15b0-475e-b484-c172fe532d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.672303 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749018f0-15b0-475e-b484-c172fe532d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.673170 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749018f0-15b0-475e-b484-c172fe532d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.674822 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749018f0-15b0-475e-b484-c172fe532d95 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.684337 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1405/2818] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:32.688608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1372fc-7151-4fbd-9631-b913919b372b admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.698690 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1372fc-7151-4fbd-9631-b913919b372b admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.704758 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6e91a-6de6-4703-a99b-b615b6d450d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.705630 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6e91a-6de6-4703-a99b-b615b6d450d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.705913 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6e91a-6de6-4703-a99b-b615b6d450d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.706186 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6e91a-6de6-4703-a99b-b615b6d450d7 admin admin] PATH_INFO: `/v3/projects/3f89ca4e79d8413b820efcee5a67f105/users/0dab863ca6af4b179e671c5dc92ad62a/roles/548abad662724741a3261205ee7cb828` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.708197 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6e91a-6de6-4703-a99b-b615b6d450d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f89ca4e79d8413b820efcee5a67f105, user_id=0dab863ca6af4b179e671c5dc92ad62a, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.710852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6e91a-6de6-4703-a99b-b615b6d450d7 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.721450 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1414/2819] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:32 2022] PUT /identity/v3/projects/3f89ca4e79d8413b820efcee5a67f105/users/0dab863ca6af4b179e671c5dc92ad62a/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:32.731587 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9197b4-54ee-4c6b-9cd2-9c1f9c492991 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.732020 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9197b4-54ee-4c6b-9cd2-9c1f9c492991 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.732304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9197b4-54ee-4c6b-9cd2-9c1f9c492991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.757593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-ea9197b4-54ee-4c6b-9cd2-9c1f9c492991 None None] MFA Rules not processed for user `0dab863ca6af4b179e671c5dc92ad62a`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:32.758803 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-ea9197b4-54ee-4c6b-9cd2-9c1f9c492991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:32.824312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1406/2820] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:32.834035 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6e91a-6de6-4703-a99b-b615b6d450d7 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.835779 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-01f6e91a-6de6-4703-a99b-b615b6d450d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:32.889570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6e91a-6de6-4703-a99b-b615b6d450d7 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.893815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7a2b-2f64-4378-81f1-0227ad5d8ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.894489 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7a2b-2f64-4378-81f1-0227ad5d8ddc service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.894773 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7a2b-2f64-4378-81f1-0227ad5d8ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.895050 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7a2b-2f64-4378-81f1-0227ad5d8ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.903830 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc7a2b-2f64-4378-81f1-0227ad5d8ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.905246 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc7a2b-2f64-4378-81f1-0227ad5d8ddc service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.914998 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1415/2821] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:34.133706 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9197b4-54ee-4c6b-9cd2-9c1f9c492991 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.192115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9197b4-54ee-4c6b-9cd2-9c1f9c492991 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.196562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.197414 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.197696 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.197969 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] PATH_INFO: `/v3/users/4de0abd2378f462c98d8916e2d513ac6` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.199162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de0abd2378f462c98d8916e2d513ac6)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.201074 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.245141 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de0abd2378f462c98d8916e2d513ac6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.252332 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de0abd2378f462c98d8916e2d513ac6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.263390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de0abd2378f462c98d8916e2d513ac6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.264056 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de0abd2378f462c98d8916e2d513ac6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.264655 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de0abd2378f462c98d8916e2d513ac6'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.278583 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1407/2822] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:34 2022] DELETE /identity/v3/users/4de0abd2378f462c98d8916e2d513ac6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:34.283055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07c20e-7453-40cb-9d5f-6f44add3e248 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.283532 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07c20e-7453-40cb-9d5f-6f44add3e248 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.283626 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07c20e-7453-40cb-9d5f-6f44add3e248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.307927 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-8b07c20e-7453-40cb-9d5f-6f44add3e248 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:34.309255 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8b07c20e-7453-40cb-9d5f-6f44add3e248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:34.370304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1416/2823] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:34.380723 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.382119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:34.438267 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696af4b-efd1-455d-99d6-feff42b23834 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.444915 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a061c-4841-41fd-93a3-05841afbc267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.445662 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a061c-4841-41fd-93a3-05841afbc267 service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.445947 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a061c-4841-41fd-93a3-05841afbc267 service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.446246 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a061c-4841-41fd-93a3-05841afbc267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.456213 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a061c-4841-41fd-93a3-05841afbc267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.457757 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a061c-4841-41fd-93a3-05841afbc267 service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.467606 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1408/2824] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:47:34.727789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07c20e-7453-40cb-9d5f-6f44add3e248 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.729248 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-8b07c20e-7453-40cb-9d5f-6f44add3e248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:34.742928 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07c20e-7453-40cb-9d5f-6f44add3e248 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.747921 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.748810 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.749091 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.749415 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] PATH_INFO: `/v3/projects/e1e5c66c50ca40ca9db6a9549cab3c19` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.750621 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e5c66c50ca40ca9db6a9549cab3c19)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.752646 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.798612 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e5c66c50ca40ca9db6a9549cab3c19', 'request_id': 'req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.803756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e5c66c50ca40ca9db6a9549cab3c19', 'request_id': 'req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.810674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e5c66c50ca40ca9db6a9549cab3c19', 'request_id': 'req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.821169 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] The token cache is being invalidate because project e1e5c66c50ca40ca9db6a9549cab3c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:34.821455 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.822077 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.823674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1417/2825] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:34 2022] DELETE /identity/v3/projects/e1e5c66c50ca40ca9db6a9549cab3c19 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:34.827716 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a061c-4841-41fd-93a3-05841afbc267 service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.837120 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a061c-4841-41fd-93a3-05841afbc267 service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.891518 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d1c6d-e9c2-4d95-86dc-8b3a06fa6d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.892382 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d1c6d-e9c2-4d95-86dc-8b3a06fa6d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.892664 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d1c6d-e9c2-4d95-86dc-8b3a06fa6d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.892941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d1c6d-e9c2-4d95-86dc-8b3a06fa6d75 admin admin] PATH_INFO: `/v3/users/0dab863ca6af4b179e671c5dc92ad62a` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.894121 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d1c6d-e9c2-4d95-86dc-8b3a06fa6d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dab863ca6af4b179e671c5dc92ad62a)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.896059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d1c6d-e9c2-4d95-86dc-8b3a06fa6d75 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.938781 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-a69d1c6d-e9c2-4d95-86dc-8b3a06fa6d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dab863ca6af4b179e671c5dc92ad62a'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.945271 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-a69d1c6d-e9c2-4d95-86dc-8b3a06fa6d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dab863ca6af4b179e671c5dc92ad62a'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.957981 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-a69d1c6d-e9c2-4d95-86dc-8b3a06fa6d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dab863ca6af4b179e671c5dc92ad62a'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.958690 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-a69d1c6d-e9c2-4d95-86dc-8b3a06fa6d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dab863ca6af4b179e671c5dc92ad62a'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.959298 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-a69d1c6d-e9c2-4d95-86dc-8b3a06fa6d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dab863ca6af4b179e671c5dc92ad62a'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:34.972909 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1409/2826] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:34 2022] DELETE /identity/v3/users/0dab863ca6af4b179e671c5dc92ad62a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:35.225461 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:35.226898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:35.239706 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6c5b4-0e34-4937-bc54-4866d63b9fe1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:35.298615 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79668e09-6cf2-4aba-9205-a90653dd0664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:35.299697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79668e09-6cf2-4aba-9205-a90653dd0664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.299861 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79668e09-6cf2-4aba-9205-a90653dd0664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.300135 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79668e09-6cf2-4aba-9205-a90653dd0664 admin admin] PATH_INFO: `/v3/projects/3f89ca4e79d8413b820efcee5a67f105` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.301317 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79668e09-6cf2-4aba-9205-a90653dd0664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f89ca4e79d8413b820efcee5a67f105)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:35.303248 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79668e09-6cf2-4aba-9205-a90653dd0664 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:35.349362 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-79668e09-6cf2-4aba-9205-a90653dd0664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f89ca4e79d8413b820efcee5a67f105', 'request_id': 'req-79668e09-6cf2-4aba-9205-a90653dd0664'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:35.354372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-79668e09-6cf2-4aba-9205-a90653dd0664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f89ca4e79d8413b820efcee5a67f105', 'request_id': 'req-79668e09-6cf2-4aba-9205-a90653dd0664'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:35.361678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-79668e09-6cf2-4aba-9205-a90653dd0664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f89ca4e79d8413b820efcee5a67f105', 'request_id': 'req-79668e09-6cf2-4aba-9205-a90653dd0664'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:35.372651 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-79668e09-6cf2-4aba-9205-a90653dd0664 admin admin] The token cache is being invalidate because project 3f89ca4e79d8413b820efcee5a67f105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:35.372936 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-79668e09-6cf2-4aba-9205-a90653dd0664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:35.373560 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-79668e09-6cf2-4aba-9205-a90653dd0664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:35.375102 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1418/2827] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:35 2022] DELETE /identity/v3/projects/3f89ca4e79d8413b820efcee5a67f105 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:35.379996 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5955d-6053-47bd-b045-1645022e2bf6 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.380519 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5955d-6053-47bd-b045-1645022e2bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.380631 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5955d-6053-47bd-b045-1645022e2bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.397918 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-49e5955d-6053-47bd-b045-1645022e2bf6 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:35.399114 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-49e5955d-6053-47bd-b045-1645022e2bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:35.454265 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1410/2828] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:35.461814 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b80f18-52aa-4228-ad31-06864d15690f None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.462096 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b80f18-52aa-4228-ad31-06864d15690f None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.462392 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b80f18-52aa-4228-ad31-06864d15690f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.480343 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-76b80f18-52aa-4228-ad31-06864d15690f None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:35.481498 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-76b80f18-52aa-4228-ad31-06864d15690f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:35.489857 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1419/2829] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:35.493786 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5955d-6053-47bd-b045-1645022e2bf6 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:35.503042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5955d-6053-47bd-b045-1645022e2bf6 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:35.507566 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763076b6-ed5a-4b0a-966e-4c92d0f88969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:35.508206 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763076b6-ed5a-4b0a-966e-4c92d0f88969 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.508485 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763076b6-ed5a-4b0a-966e-4c92d0f88969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.508756 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763076b6-ed5a-4b0a-966e-4c92d0f88969 admin admin] PATH_INFO: `/v3/domains` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.509468 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763076b6-ed5a-4b0a-966e-4c92d0f88969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79371) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:47:35.509801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763076b6-ed5a-4b0a-966e-4c92d0f88969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:35.511419 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763076b6-ed5a-4b0a-966e-4c92d0f88969 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:35.522193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1411/2830] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:47:35.526070 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b80f18-52aa-4228-ad31-06864d15690f None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:35.535346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b80f18-52aa-4228-ad31-06864d15690f None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:35.539844 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be800-3b49-4921-b57d-656c96750bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:35.540473 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be800-3b49-4921-b57d-656c96750bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.540751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be800-3b49-4921-b57d-656c96750bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.541018 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be800-3b49-4921-b57d-656c96750bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.541699 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be800-3b49-4921-b57d-656c96750bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:35.543617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be800-3b49-4921-b57d-656c96750bd2 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:35.568273 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1420/2831] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:35 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:35.572224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763076b6-ed5a-4b0a-966e-4c92d0f88969 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:35.581710 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763076b6-ed5a-4b0a-966e-4c92d0f88969 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:35.635761 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6813b-6a5d-4d09-b971-8cf53257c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:35.636339 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6813b-6a5d-4d09-b971-8cf53257c352 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.636618 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6813b-6a5d-4d09-b971-8cf53257c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.636888 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6813b-6a5d-4d09-b971-8cf53257c352 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.637576 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6813b-6a5d-4d09-b971-8cf53257c352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:35.639498 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6813b-6a5d-4d09-b971-8cf53257c352 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:35.658978 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1412/2832] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:35 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:35.663057 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be800-3b49-4921-b57d-656c96750bd2 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:35.673783 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be800-3b49-4921-b57d-656c96750bd2 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:35.678505 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea792f0-7445-49dc-ba59-bf0874d72190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:35.679154 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea792f0-7445-49dc-ba59-bf0874d72190 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.679437 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea792f0-7445-49dc-ba59-bf0874d72190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.679711 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea792f0-7445-49dc-ba59-bf0874d72190 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.680429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea792f0-7445-49dc-ba59-bf0874d72190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:35.682017 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea792f0-7445-49dc-ba59-bf0874d72190 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:35.692826 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1421/2833] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:35.696809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6813b-6a5d-4d09-b971-8cf53257c352 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:35.707449 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6813b-6a5d-4d09-b971-8cf53257c352 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:35.711992 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f19130-73a2-44a4-a253-1b62460d7fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:35.712645 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f19130-73a2-44a4-a253-1b62460d7fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.712928 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f19130-73a2-44a4-a253-1b62460d7fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.713209 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f19130-73a2-44a4-a253-1b62460d7fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.713952 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f19130-73a2-44a4-a253-1b62460d7fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:35.715592 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f19130-73a2-44a4-a253-1b62460d7fa7 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:35.725727 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1413/2834] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:35.729827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea792f0-7445-49dc-ba59-bf0874d72190 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:35.740247 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea792f0-7445-49dc-ba59-bf0874d72190 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:35.744735 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6406efd-e6d3-47c1-a8a0-2fe79fcc8f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:35.745588 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6406efd-e6d3-47c1-a8a0-2fe79fcc8f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.745862 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6406efd-e6d3-47c1-a8a0-2fe79fcc8f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.746132 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6406efd-e6d3-47c1-a8a0-2fe79fcc8f67 admin admin] PATH_INFO: `/v3/projects/321f4100760546328489a5622318fc96/users/ee25c987c5524e809b16ee01573e665e/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.760618 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6406efd-e6d3-47c1-a8a0-2fe79fcc8f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=321f4100760546328489a5622318fc96, user_id=ee25c987c5524e809b16ee01573e665e, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:35.763372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6406efd-e6d3-47c1-a8a0-2fe79fcc8f67 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:35.775930 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1422/2835] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:35 2022] PUT /identity/v3/projects/321f4100760546328489a5622318fc96/users/ee25c987c5524e809b16ee01573e665e/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:35.787216 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd482130-d766-413f-afd8-db1f0172b253 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.787507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd482130-d766-413f-afd8-db1f0172b253 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.787788 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd482130-d766-413f-afd8-db1f0172b253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.815008 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-fd482130-d766-413f-afd8-db1f0172b253 None None] MFA Rules not processed for user `ee25c987c5524e809b16ee01573e665e`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:35.816241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-fd482130-d766-413f-afd8-db1f0172b253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:35.876829 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1414/2836] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:35.881301 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6406efd-e6d3-47c1-a8a0-2fe79fcc8f67 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:35.939037 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6406efd-e6d3-47c1-a8a0-2fe79fcc8f67 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:35.943547 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f59b9-d7eb-457f-97d9-29489e426a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:35.944182 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f59b9-d7eb-457f-97d9-29489e426a9c admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.944460 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f59b9-d7eb-457f-97d9-29489e426a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.944732 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f59b9-d7eb-457f-97d9-29489e426a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.945409 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f59b9-d7eb-457f-97d9-29489e426a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:35.947316 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f59b9-d7eb-457f-97d9-29489e426a9c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:35.970809 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1423/2837] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:35 2022] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:35.974821 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd482130-d766-413f-afd8-db1f0172b253 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:35.985965 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd482130-d766-413f-afd8-db1f0172b253 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:36.039375 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c675a26-c9d7-4d9a-8cdb-ff9dc73f5146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:36.040033 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c675a26-c9d7-4d9a-8cdb-ff9dc73f5146 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.040318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c675a26-c9d7-4d9a-8cdb-ff9dc73f5146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.040593 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c675a26-c9d7-4d9a-8cdb-ff9dc73f5146 admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.041273 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c675a26-c9d7-4d9a-8cdb-ff9dc73f5146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:36.043316 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c675a26-c9d7-4d9a-8cdb-ff9dc73f5146 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:36.062724 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1415/2838] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:35 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:36.066564 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f59b9-d7eb-457f-97d9-29489e426a9c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:36.076605 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f59b9-d7eb-457f-97d9-29489e426a9c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:36.081098 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417e74b-b516-45cd-86cb-4b6d132d3966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:36.081740 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417e74b-b516-45cd-86cb-4b6d132d3966 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.082019 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417e74b-b516-45cd-86cb-4b6d132d3966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.082340 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417e74b-b516-45cd-86cb-4b6d132d3966 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.083055 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417e74b-b516-45cd-86cb-4b6d132d3966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:36.084629 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417e74b-b516-45cd-86cb-4b6d132d3966 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:36.095905 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1424/2839] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:36.099559 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c675a26-c9d7-4d9a-8cdb-ff9dc73f5146 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:36.109301 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c675a26-c9d7-4d9a-8cdb-ff9dc73f5146 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:36.114864 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c1a76-e6bb-42fa-b81a-46c9925843b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:36.115517 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1a76-e6bb-42fa-b81a-46c9925843b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.115801 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1a76-e6bb-42fa-b81a-46c9925843b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.116077 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1a76-e6bb-42fa-b81a-46c9925843b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.116804 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c1a76-e6bb-42fa-b81a-46c9925843b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:36.118422 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c1a76-e6bb-42fa-b81a-46c9925843b3 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:36.127891 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1416/2840] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:36.132350 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417e74b-b516-45cd-86cb-4b6d132d3966 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:36.142095 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417e74b-b516-45cd-86cb-4b6d132d3966 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:36.146624 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528869c1-ffcd-47e6-8957-c5d7be70bc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:36.147491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528869c1-ffcd-47e6-8957-c5d7be70bc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.147772 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528869c1-ffcd-47e6-8957-c5d7be70bc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.148046 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528869c1-ffcd-47e6-8957-c5d7be70bc43 admin admin] PATH_INFO: `/v3/projects/d4ac9440fe604a9295df3a204be6f75f/users/36471daa6b9d492ab2215ae312c9e4db/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.162433 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528869c1-ffcd-47e6-8957-c5d7be70bc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ac9440fe604a9295df3a204be6f75f, user_id=36471daa6b9d492ab2215ae312c9e4db, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:36.165052 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528869c1-ffcd-47e6-8957-c5d7be70bc43 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:36.178678 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1425/2841] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:36 2022] PUT /identity/v3/projects/d4ac9440fe604a9295df3a204be6f75f/users/36471daa6b9d492ab2215ae312c9e4db/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:36.188899 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106c39c-c514-4bda-a3da-e8c83be567a8 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.189239 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106c39c-c514-4bda-a3da-e8c83be567a8 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.189523 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106c39c-c514-4bda-a3da-e8c83be567a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.215714 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-8106c39c-c514-4bda-a3da-e8c83be567a8 None None] MFA Rules not processed for user `36471daa6b9d492ab2215ae312c9e4db`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:36.216902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-8106c39c-c514-4bda-a3da-e8c83be567a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:36.276830 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1417/2842] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:36.281224 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528869c1-ffcd-47e6-8957-c5d7be70bc43 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:36.339708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528869c1-ffcd-47e6-8957-c5d7be70bc43 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:36.344827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d890e51-ee77-45fa-a1a7-60e499cf0dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:36.345471 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d890e51-ee77-45fa-a1a7-60e499cf0dca admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.345753 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d890e51-ee77-45fa-a1a7-60e499cf0dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.346028 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d890e51-ee77-45fa-a1a7-60e499cf0dca admin admin] PATH_INFO: `/v3/projects` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.346748 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d890e51-ee77-45fa-a1a7-60e499cf0dca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:36.348633 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d890e51-ee77-45fa-a1a7-60e499cf0dca admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:36.373158 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1426/2843] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:36 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:36.377190 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106c39c-c514-4bda-a3da-e8c83be567a8 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:36.387399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106c39c-c514-4bda-a3da-e8c83be567a8 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:36.439474 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3c9c5-cd60-43fb-a8c9-130c9dc218db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:36.440064 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3c9c5-cd60-43fb-a8c9-130c9dc218db admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.440344 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3c9c5-cd60-43fb-a8c9-130c9dc218db admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.440616 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3c9c5-cd60-43fb-a8c9-130c9dc218db admin admin] PATH_INFO: `/v3/users` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.441294 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3c9c5-cd60-43fb-a8c9-130c9dc218db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:36.443224 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3c9c5-cd60-43fb-a8c9-130c9dc218db admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:36.463235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1418/2844] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:36 2022] POST /identity/v3/users => generated 299 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:36.467259 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d890e51-ee77-45fa-a1a7-60e499cf0dca admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:36.480914 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d890e51-ee77-45fa-a1a7-60e499cf0dca admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:36.485789 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32587f47-9292-4408-8a6e-89653e1f8d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:36.486742 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32587f47-9292-4408-8a6e-89653e1f8d10 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.487025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32587f47-9292-4408-8a6e-89653e1f8d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.487301 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32587f47-9292-4408-8a6e-89653e1f8d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.488025 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32587f47-9292-4408-8a6e-89653e1f8d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:36.489617 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32587f47-9292-4408-8a6e-89653e1f8d10 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:36.500866 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1427/2845] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:36.505172 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3c9c5-cd60-43fb-a8c9-130c9dc218db admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:36.514687 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3c9c5-cd60-43fb-a8c9-130c9dc218db admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:36.519729 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a2b26-6813-4800-9c24-08da34583f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:36.520599 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a2b26-6813-4800-9c24-08da34583f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.520876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a2b26-6813-4800-9c24-08da34583f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.521146 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a2b26-6813-4800-9c24-08da34583f63 admin admin] PATH_INFO: `/v3/projects/960cb1060a8443158056eefff296305a/users/73228bf33cf847419a458cdcbdfd2e3d/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.535470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a2b26-6813-4800-9c24-08da34583f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960cb1060a8443158056eefff296305a, user_id=73228bf33cf847419a458cdcbdfd2e3d, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:36.538093 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a2b26-6813-4800-9c24-08da34583f63 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:36.550537 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1419/2846] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:36 2022] PUT /identity/v3/projects/960cb1060a8443158056eefff296305a/users/73228bf33cf847419a458cdcbdfd2e3d/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:36.554660 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32587f47-9292-4408-8a6e-89653e1f8d10 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:36.564311 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32587f47-9292-4408-8a6e-89653e1f8d10 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:36.618365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60fe83-0ad0-437e-9351-45b8711197e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:36.619006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60fe83-0ad0-437e-9351-45b8711197e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.619282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60fe83-0ad0-437e-9351-45b8711197e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.619559 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60fe83-0ad0-437e-9351-45b8711197e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.620262 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60fe83-0ad0-437e-9351-45b8711197e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:36.621827 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60fe83-0ad0-437e-9351-45b8711197e4 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:36.631242 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1428/2847] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:36.635391 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a2b26-6813-4800-9c24-08da34583f63 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:36.645908 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a2b26-6813-4800-9c24-08da34583f63 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:36.650632 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ab651-f5ca-4d6e-96e8-e139c9c4eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:36.651507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ab651-f5ca-4d6e-96e8-e139c9c4eb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.651785 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ab651-f5ca-4d6e-96e8-e139c9c4eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.652059 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ab651-f5ca-4d6e-96e8-e139c9c4eb99 admin admin] PATH_INFO: `/v3/projects/960cb1060a8443158056eefff296305a/users/73228bf33cf847419a458cdcbdfd2e3d/roles/548abad662724741a3261205ee7cb828` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.653995 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ab651-f5ca-4d6e-96e8-e139c9c4eb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960cb1060a8443158056eefff296305a, user_id=73228bf33cf847419a458cdcbdfd2e3d, role_id=548abad662724741a3261205ee7cb828)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:36.657241 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ab651-f5ca-4d6e-96e8-e139c9c4eb99 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:36.667082 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1420/2848] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:36 2022] PUT /identity/v3/projects/960cb1060a8443158056eefff296305a/users/73228bf33cf847419a458cdcbdfd2e3d/roles/548abad662724741a3261205ee7cb828 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:36.678598 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149e502-f107-474d-b123-cacf32bd00eb None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.678886 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149e502-f107-474d-b123-cacf32bd00eb None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.679162 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149e502-f107-474d-b123-cacf32bd00eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.706195 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-a149e502-f107-474d-b123-cacf32bd00eb None None] MFA Rules not processed for user `73228bf33cf847419a458cdcbdfd2e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:36.707351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a149e502-f107-474d-b123-cacf32bd00eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:36.772435 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1429/2849] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:36.782555 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ab651-f5ca-4d6e-96e8-e139c9c4eb99 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:36.784237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-db1ab651-f5ca-4d6e-96e8-e139c9c4eb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:36.838342 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ab651-f5ca-4d6e-96e8-e139c9c4eb99 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:36.841989 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d639-f33c-4b06-aec2-52a6b2c029f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:36.842663 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d639-f33c-4b06-aec2-52a6b2c029f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:36.842945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d639-f33c-4b06-aec2-52a6b2c029f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:36.843219 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d639-f33c-4b06-aec2-52a6b2c029f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:36.852327 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450d639-f33c-4b06-aec2-52a6b2c029f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:36.853754 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450d639-f33c-4b06-aec2-52a6b2c029f9 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:36.863691 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1421/2850] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:37.299008 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149e502-f107-474d-b123-cacf32bd00eb None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:37.300430 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a149e502-f107-474d-b123-cacf32bd00eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:37.312153 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149e502-f107-474d-b123-cacf32bd00eb None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:37.316292 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae8157-f986-45c4-a314-d2b5a0c3ee9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:37.316948 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae8157-f986-45c4-a314-d2b5a0c3ee9f service cinder] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:37.317223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae8157-f986-45c4-a314-d2b5a0c3ee9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:37.317494 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae8157-f986-45c4-a314-d2b5a0c3ee9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:37.370294 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae8157-f986-45c4-a314-d2b5a0c3ee9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:37.371707 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae8157-f986-45c4-a314-d2b5a0c3ee9f service cinder] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:37.380923 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1430/2851] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:41.326880 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d639-f33c-4b06-aec2-52a6b2c029f9 service cinder] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:41.335543 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d639-f33c-4b06-aec2-52a6b2c029f9 service cinder] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:41.339210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0739906-a2d7-41e8-bb7b-5d230e3d18a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ca95750bea45019bdc0b34b8f445df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:41.339832 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0739906-a2d7-41e8-bb7b-5d230e3d18a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:41.340107 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0739906-a2d7-41e8-bb7b-5d230e3d18a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:41.340376 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0739906-a2d7-41e8-bb7b-5d230e3d18a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:41.393935 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0739906-a2d7-41e8-bb7b-5d230e3d18a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:41.395319 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0739906-a2d7-41e8-bb7b-5d230e3d18a4 service cinder] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:41.403783 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1422/2852] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:47:43.351072 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae8157-f986-45c4-a314-d2b5a0c3ee9f service cinder] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:43.411179 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae8157-f986-45c4-a314-d2b5a0c3ee9f service cinder] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:43.415673 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:43.416608 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:43.416888 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:43.417159 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] PATH_INFO: `/v3/users/ee25c987c5524e809b16ee01573e665e` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:43.418397 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee25c987c5524e809b16ee01573e665e)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:43.420305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:43.463346 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee25c987c5524e809b16ee01573e665e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:43.470356 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee25c987c5524e809b16ee01573e665e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:43.481846 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee25c987c5524e809b16ee01573e665e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:43.482502 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee25c987c5524e809b16ee01573e665e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:43.489531 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee25c987c5524e809b16ee01573e665e'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:43.495229 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1431/2853] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:43 2022] DELETE /identity/v3/users/ee25c987c5524e809b16ee01573e665e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:43.499864 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc10b1-fce6-4b30-bcf7-c31a23b71429 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:43.500846 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc10b1-fce6-4b30-bcf7-c31a23b71429 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:43.500951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc10b1-fce6-4b30-bcf7-c31a23b71429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:43.518169 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-18cc10b1-fce6-4b30-bcf7-c31a23b71429 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:43.519369 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-18cc10b1-fce6-4b30-bcf7-c31a23b71429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:43.574193 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1423/2854] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:43.584571 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:43.585961 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:43.640067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72eeefa-0f9d-4b5c-8935-07ef15542ac1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:43.644256 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dec3ba-9a7c-4704-8b67-cdb4d1589e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:43.644882 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dec3ba-9a7c-4704-8b67-cdb4d1589e5b service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:43.645161 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dec3ba-9a7c-4704-8b67-cdb4d1589e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:43.645468 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dec3ba-9a7c-4704-8b67-cdb4d1589e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:43.654250 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dec3ba-9a7c-4704-8b67-cdb4d1589e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:43.655669 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dec3ba-9a7c-4704-8b67-cdb4d1589e5b service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:43.664807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1432/2855] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:43.921318 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc10b1-fce6-4b30-bcf7-c31a23b71429 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:43.923402 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-18cc10b1-fce6-4b30-bcf7-c31a23b71429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:43.935671 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc10b1-fce6-4b30-bcf7-c31a23b71429 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:43.941036 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:43.942624 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:43.943084 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:43.943374 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] PATH_INFO: `/v3/projects/321f4100760546328489a5622318fc96` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:43.944560 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=321f4100760546328489a5622318fc96)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:43.946501 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:43.991878 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '321f4100760546328489a5622318fc96', 'request_id': 'req-574ec274-41ae-48cc-b532-cf00cc16fd04'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:43.997742 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '321f4100760546328489a5622318fc96', 'request_id': 'req-574ec274-41ae-48cc-b532-cf00cc16fd04'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.005704 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '321f4100760546328489a5622318fc96', 'request_id': 'req-574ec274-41ae-48cc-b532-cf00cc16fd04'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.015447 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] The token cache is being invalidate because project 321f4100760546328489a5622318fc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:44.015728 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.016359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.017853 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1424/2856] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:43 2022] DELETE /identity/v3/projects/321f4100760546328489a5622318fc96 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:44.021949 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dec3ba-9a7c-4704-8b67-cdb4d1589e5b service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:44.031570 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dec3ba-9a7c-4704-8b67-cdb4d1589e5b service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:44.086674 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:44.087541 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:44.088284 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:44.088571 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] PATH_INFO: `/v3/users/36471daa6b9d492ab2215ae312c9e4db` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:44.089845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36471daa6b9d492ab2215ae312c9e4db)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:44.091852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:44.136190 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36471daa6b9d492ab2215ae312c9e4db'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.142724 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36471daa6b9d492ab2215ae312c9e4db'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.154503 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36471daa6b9d492ab2215ae312c9e4db'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.155170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36471daa6b9d492ab2215ae312c9e4db'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.161803 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36471daa6b9d492ab2215ae312c9e4db'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.167542 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1433/2857] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:44 2022] DELETE /identity/v3/users/36471daa6b9d492ab2215ae312c9e4db => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:44.421289 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:44.423435 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:44.436750 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ec274-41ae-48cc-b532-cf00cc16fd04 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:44.492450 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:44.493322 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:44.493604 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:44.493898 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] PATH_INFO: `/v3/projects/d4ac9440fe604a9295df3a204be6f75f` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:44.495113 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ac9440fe604a9295df3a204be6f75f)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:44.497012 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:44.539919 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ac9440fe604a9295df3a204be6f75f', 'request_id': 'req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.545620 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ac9440fe604a9295df3a204be6f75f', 'request_id': 'req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.552941 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ac9440fe604a9295df3a204be6f75f', 'request_id': 'req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.562824 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] The token cache is being invalidate because project d4ac9440fe604a9295df3a204be6f75f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:44.563141 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.563712 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.565518 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1425/2858] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:44 2022] DELETE /identity/v3/projects/d4ac9440fe604a9295df3a204be6f75f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:44.570611 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:44.572106 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:44.585062 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a1ced-a939-43a7-8b8a-0c3641d3ca39 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:44.639319 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a139a0-61f2-489a-94f4-455d285fc5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:44.640167 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a139a0-61f2-489a-94f4-455d285fc5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:44.640442 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a139a0-61f2-489a-94f4-455d285fc5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:44.640709 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a139a0-61f2-489a-94f4-455d285fc5f5 admin admin] PATH_INFO: `/v3/users/73228bf33cf847419a458cdcbdfd2e3d` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:44.642408 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a139a0-61f2-489a-94f4-455d285fc5f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73228bf33cf847419a458cdcbdfd2e3d)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:44.644304 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a139a0-61f2-489a-94f4-455d285fc5f5 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:44.687298 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-83a139a0-61f2-489a-94f4-455d285fc5f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73228bf33cf847419a458cdcbdfd2e3d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.694306 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-83a139a0-61f2-489a-94f4-455d285fc5f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73228bf33cf847419a458cdcbdfd2e3d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.707243 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-83a139a0-61f2-489a-94f4-455d285fc5f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73228bf33cf847419a458cdcbdfd2e3d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.707885 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-83a139a0-61f2-489a-94f4-455d285fc5f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73228bf33cf847419a458cdcbdfd2e3d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.714600 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-83a139a0-61f2-489a-94f4-455d285fc5f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73228bf33cf847419a458cdcbdfd2e3d'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:44.720970 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1434/2859] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:44 2022] DELETE /identity/v3/users/73228bf33cf847419a458cdcbdfd2e3d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:44.975008 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:44.976524 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:44.989518 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1564ae-706e-4eea-ab9c-cfd1c54daeef admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:45.044658 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf6ddc-06e1-47b1-8d13-d4287164de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:45.045526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf6ddc-06e1-47b1-8d13-d4287164de92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:45.045809 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf6ddc-06e1-47b1-8d13-d4287164de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:45.046115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf6ddc-06e1-47b1-8d13-d4287164de92 admin admin] PATH_INFO: `/v3/projects/960cb1060a8443158056eefff296305a` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:45.047317 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf6ddc-06e1-47b1-8d13-d4287164de92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=960cb1060a8443158056eefff296305a)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:45.049255 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf6ddc-06e1-47b1-8d13-d4287164de92 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:45.100304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8daf6ddc-06e1-47b1-8d13-d4287164de92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960cb1060a8443158056eefff296305a', 'request_id': 'req-8daf6ddc-06e1-47b1-8d13-d4287164de92'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:45.106312 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8daf6ddc-06e1-47b1-8d13-d4287164de92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960cb1060a8443158056eefff296305a', 'request_id': 'req-8daf6ddc-06e1-47b1-8d13-d4287164de92'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:45.113725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8daf6ddc-06e1-47b1-8d13-d4287164de92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960cb1060a8443158056eefff296305a', 'request_id': 'req-8daf6ddc-06e1-47b1-8d13-d4287164de92'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:45.123892 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8daf6ddc-06e1-47b1-8d13-d4287164de92 admin admin] The token cache is being invalidate because project 960cb1060a8443158056eefff296305a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:45.124177 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8daf6ddc-06e1-47b1-8d13-d4287164de92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:45.124799 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-8daf6ddc-06e1-47b1-8d13-d4287164de92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:45.126902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1426/2860] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:44 2022] DELETE /identity/v3/projects/960cb1060a8443158056eefff296305a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:45.133048 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673b97c-149d-4180-a458-a2d1ba0138a3 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:45.133338 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673b97c-149d-4180-a458-a2d1ba0138a3 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:45.133616 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673b97c-149d-4180-a458-a2d1ba0138a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:45.152973 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-0673b97c-149d-4180-a458-a2d1ba0138a3 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:45.154150 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0673b97c-149d-4180-a458-a2d1ba0138a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:45.209675 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1435/2861] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:45.218103 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8942b-87d6-4dc3-adc0-9735501a6ee5 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:45.218470 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8942b-87d6-4dc3-adc0-9735501a6ee5 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:45.218813 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8942b-87d6-4dc3-adc0-9735501a6ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:45.236615 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-e9b8942b-87d6-4dc3-adc0-9735501a6ee5 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:45.237784 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-e9b8942b-87d6-4dc3-adc0-9735501a6ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:45.245351 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1427/2862] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:45.249380 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673b97c-149d-4180-a458-a2d1ba0138a3 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:45.259351 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673b97c-149d-4180-a458-a2d1ba0138a3 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:45.263838 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920ceb7-984a-497a-a0f0-a390dd10188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:45.264475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920ceb7-984a-497a-a0f0-a390dd10188c admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:45.264756 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920ceb7-984a-497a-a0f0-a390dd10188c admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:45.265030 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920ceb7-984a-497a-a0f0-a390dd10188c admin admin] PATH_INFO: `/v3/domains` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:45.265746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920ceb7-984a-497a-a0f0-a390dd10188c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:47:45.266051 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920ceb7-984a-497a-a0f0-a390dd10188c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:45.268282 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920ceb7-984a-497a-a0f0-a390dd10188c admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:45.279438 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1436/2863] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Feb 21 01:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:47:45.283599 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8942b-87d6-4dc3-adc0-9735501a6ee5 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:45.297148 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8942b-87d6-4dc3-adc0-9735501a6ee5 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:45.301843 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb8424-c866-446f-b58d-fe8532ec7f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:45.302521 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb8424-c866-446f-b58d-fe8532ec7f14 admin admin] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:45.302812 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb8424-c866-446f-b58d-fe8532ec7f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:45.303086 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb8424-c866-446f-b58d-fe8532ec7f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:45.303789 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb8424-c866-446f-b58d-fe8532ec7f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:45.305762 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb8424-c866-446f-b58d-fe8532ec7f14 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:45.333094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1428/2864] 10.222.0.79 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:45 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:45.337182 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920ceb7-984a-497a-a0f0-a390dd10188c admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:45.346846 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920ceb7-984a-497a-a0f0-a390dd10188c admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:45.400021 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef72fe-2708-4bc3-9ae4-0c76d2990ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:45.400681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef72fe-2708-4bc3-9ae4-0c76d2990ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:45.400960 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef72fe-2708-4bc3-9ae4-0c76d2990ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:45.401234 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef72fe-2708-4bc3-9ae4-0c76d2990ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:45.401951 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef72fe-2708-4bc3-9ae4-0c76d2990ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:45.403907 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef72fe-2708-4bc3-9ae4-0c76d2990ad1 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:45.423491 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1437/2865] 10.222.0.79 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:45 2022] POST /identity/v3/users => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:45.427550 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb8424-c866-446f-b58d-fe8532ec7f14 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:45.437661 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb8424-c866-446f-b58d-fe8532ec7f14 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:45.442843 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85bb7b-d0de-46e9-a10f-dd3a7d9f7686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:45.443488 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85bb7b-d0de-46e9-a10f-dd3a7d9f7686 admin admin] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:45.443771 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85bb7b-d0de-46e9-a10f-dd3a7d9f7686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:45.444046 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85bb7b-d0de-46e9-a10f-dd3a7d9f7686 admin admin] PATH_INFO: `/v3/roles` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:45.444770 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85bb7b-d0de-46e9-a10f-dd3a7d9f7686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:45.446390 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85bb7b-d0de-46e9-a10f-dd3a7d9f7686 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:45.456330 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1429/2866] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:45.459909 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef72fe-2708-4bc3-9ae4-0c76d2990ad1 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:45.469397 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef72fe-2708-4bc3-9ae4-0c76d2990ad1 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:45.473852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a631a9-20b8-4727-9c2a-4f429f98b9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:45.474514 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a631a9-20b8-4727-9c2a-4f429f98b9aa admin admin] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:45.474796 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a631a9-20b8-4727-9c2a-4f429f98b9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:45.475067 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a631a9-20b8-4727-9c2a-4f429f98b9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:45.475775 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a631a9-20b8-4727-9c2a-4f429f98b9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:45.477320 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a631a9-20b8-4727-9c2a-4f429f98b9aa admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:45.487647 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1438/2867] 10.222.0.79 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:45.491562 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85bb7b-d0de-46e9-a10f-dd3a7d9f7686 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:45.501988 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85bb7b-d0de-46e9-a10f-dd3a7d9f7686 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:45.506698 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a9760-e027-4db4-ac24-81844751c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:45.507561 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a9760-e027-4db4-ac24-81844751c488 admin admin] REQUEST_METHOD: `PUT` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:45.507844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a9760-e027-4db4-ac24-81844751c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:45.508119 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a9760-e027-4db4-ac24-81844751c488 admin admin] PATH_INFO: `/v3/projects/e08ecd7cd3744ba783ccf089d5474f2f/users/9e119f14a2f54c40919141fe0b49592b/roles/3d85c07c87374b898492488d6e608a27` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:45.522034 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a9760-e027-4db4-ac24-81844751c488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08ecd7cd3744ba783ccf089d5474f2f, user_id=9e119f14a2f54c40919141fe0b49592b, role_id=3d85c07c87374b898492488d6e608a27)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:45.524810 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a9760-e027-4db4-ac24-81844751c488 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:45.537148 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1430/2868] 10.222.0.79 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:45 2022] PUT /identity/v3/projects/e08ecd7cd3744ba783ccf089d5474f2f/users/9e119f14a2f54c40919141fe0b49592b/roles/3d85c07c87374b898492488d6e608a27 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:45.547815 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9992-a515-4d12-8824-968035e90a38 None None] REQUEST_METHOD: `POST` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:45.548614 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9992-a515-4d12-8824-968035e90a38 None None] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:45.548890 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9992-a515-4d12-8824-968035e90a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:45.574486 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.auth.core [None req-43ee9992-a515-4d12-8824-968035e90a38 None None] MFA Rules not processed for user `9e119f14a2f54c40919141fe0b49592b`. Rule list: `[]` (Enabled: `True`). {{(pid=79370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:45.575670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-43ee9992-a515-4d12-8824-968035e90a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:45.636338 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1439/2869] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:47:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:45.647675 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a9760-e027-4db4-ac24-81844751c488 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:45.649308 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-9e3a9760-e027-4db4-ac24-81844751c488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:45.702399 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a9760-e027-4db4-ac24-81844751c488 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:45.706226 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7b490-8ac7-481b-b775-2228cca6c75a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68b3bc64dc94865a72cea0988fa9c65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:45.706945 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7b490-8ac7-481b-b775-2228cca6c75a service glance] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:45.707235 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7b490-8ac7-481b-b775-2228cca6c75a service glance] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:45.707507 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7b490-8ac7-481b-b775-2228cca6c75a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:45.715525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7b490-8ac7-481b-b775-2228cca6c75a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:45.716934 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7b490-8ac7-481b-b775-2228cca6c75a service glance] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:45.725872 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1431/2870] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:01.072697 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9992-a515-4d12-8824-968035e90a38 None None] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:01.133006 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9992-a515-4d12-8824-968035e90a38 None None] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:01.137595 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:01.138480 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:01.138767 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:01.139043 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] PATH_INFO: `/v3/users/9e119f14a2f54c40919141fe0b49592b` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:01.140223 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e119f14a2f54c40919141fe0b49592b)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:01.142128 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:01.184987 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e119f14a2f54c40919141fe0b49592b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:01.192004 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e119f14a2f54c40919141fe0b49592b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:01.204202 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e119f14a2f54c40919141fe0b49592b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:01.204829 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e119f14a2f54c40919141fe0b49592b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:01.211729 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e119f14a2f54c40919141fe0b49592b'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:01.217429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1440/2871] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:48:01 2022] DELETE /identity/v3/users/9e119f14a2f54c40919141fe0b49592b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:01.221887 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c21f06-e62c-4587-a8ac-a52a1dfba5a4 None None] REQUEST_METHOD: `POST` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:01.222435 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c21f06-e62c-4587-a8ac-a52a1dfba5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:01.222546 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c21f06-e62c-4587-a8ac-a52a1dfba5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:01.239573 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.auth.core [None req-46c21f06-e62c-4587-a8ac-a52a1dfba5a4 None None] MFA Rules not processed for user `100e11f767f7472887d51a9dc7231480`. Rule list: `[]` (Enabled: `True`). {{(pid=79371) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:48:01.241288 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-46c21f06-e62c-4587-a8ac-a52a1dfba5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:01.296105 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1432/2872] 10.222.0.79 () {58 vars in 957 bytes} [Mon Feb 21 01:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:48:01.306083 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:01.307470 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:01.362218 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd865bc3-db7f-4b5a-982c-3eb0c284b326 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:01.366424 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea24a0-e93f-4965-8206-35c8785cb92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:01.367056 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea24a0-e93f-4965-8206-35c8785cb92d service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:01.367334 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea24a0-e93f-4965-8206-35c8785cb92d service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:01.367607 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea24a0-e93f-4965-8206-35c8785cb92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:01.376305 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea24a0-e93f-4965-8206-35c8785cb92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:01.377720 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea24a0-e93f-4965-8206-35c8785cb92d service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:01.386845 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1441/2873] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:01.635518 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c21f06-e62c-4587-a8ac-a52a1dfba5a4 None None] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:01.637045 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-46c21f06-e62c-4587-a8ac-a52a1dfba5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:01.650042 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c21f06-e62c-4587-a8ac-a52a1dfba5a4 None None] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:01.654629 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:01.655483 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:01.655762 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:01.656030 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] PATH_INFO: `/v3/projects/e08ecd7cd3744ba783ccf089d5474f2f` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:01.657246 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08ecd7cd3744ba783ccf089d5474f2f)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:01.659228 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:01.704525 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08ecd7cd3744ba783ccf089d5474f2f', 'request_id': 'req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:01.711040 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08ecd7cd3744ba783ccf089d5474f2f', 'request_id': 'req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:01.719210 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08ecd7cd3744ba783ccf089d5474f2f', 'request_id': 'req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:01.729511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] The token cache is being invalidate because project e08ecd7cd3744ba783ccf089d5474f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79371) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:48:01.729793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:01.730504 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:01.732003 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1433/2874] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:48:01 2022] DELETE /identity/v3/projects/e08ecd7cd3744ba783ccf089d5474f2f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:21.054049 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea24a0-e93f-4965-8206-35c8785cb92d service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:21.056225 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-f7ea24a0-e93f-4965-8206-35c8785cb92d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:21.067769 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea24a0-e93f-4965-8206-35c8785cb92d service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:21.119954 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a9010-1b03-4fd7-bebb-2ed7baa57be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:21.120609 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a9010-1b03-4fd7-bebb-2ed7baa57be1 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:21.120894 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a9010-1b03-4fd7-bebb-2ed7baa57be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:21.121852 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a9010-1b03-4fd7-bebb-2ed7baa57be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:21.123703 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-215a9010-1b03-4fd7-bebb-2ed7baa57be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:21.199170 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a9010-1b03-4fd7-bebb-2ed7baa57be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:21.200610 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a9010-1b03-4fd7-bebb-2ed7baa57be1 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:21.212589 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1442/2875] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:22.400634 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:22.402095 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:22.414124 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87faeba-0a3e-4ca9-8f37-f0ab7ebb7dd2 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:22.417704 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ff5e9-a1da-48b2-a1c9-615696239c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:22.418367 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ff5e9-a1da-48b2-a1c9-615696239c7a service neutron] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:22.418647 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ff5e9-a1da-48b2-a1c9-615696239c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:22.418920 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ff5e9-a1da-48b2-a1c9-615696239c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:22.420613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-bf9ff5e9-a1da-48b2-a1c9-615696239c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:22.433293 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ff5e9-a1da-48b2-a1c9-615696239c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:22.434740 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ff5e9-a1da-48b2-a1c9-615696239c7a service neutron] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:22.445621 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1434/2876] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:32.190621 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a9010-1b03-4fd7-bebb-2ed7baa57be1 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:32.199295 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a9010-1b03-4fd7-bebb-2ed7baa57be1 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:32.202746 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960c3e2-31a4-4977-92b5-965b519b90a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f00b174c88547e2ab799d89a50d5b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:32.203372 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c3e2-31a4-4977-92b5-965b519b90a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:32.203649 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c3e2-31a4-4977-92b5-965b519b90a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:32.203939 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c3e2-31a4-4977-92b5-965b519b90a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:32.205662 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-b960c3e2-31a4-4977-92b5-965b519b90a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:32.264670 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960c3e2-31a4-4977-92b5-965b519b90a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:32.266087 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960c3e2-31a4-4977-92b5-965b519b90a2 service neutron] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:32.275429 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1443/2877] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:38.693863 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ff5e9-a1da-48b2-a1c9-615696239c7a service neutron] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:38.695793 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-bf9ff5e9-a1da-48b2-a1c9-615696239c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:38.714578 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ff5e9-a1da-48b2-a1c9-615696239c7a service neutron] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:38.719319 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:38.720195 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:38.720473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:38.720951 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] PATH_INFO: `/v3/users/d40b20a8c16d4771b4410f975e9f2a9d` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:38.722162 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40b20a8c16d4771b4410f975e9f2a9d)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:38.724725 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:38.777211 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40b20a8c16d4771b4410f975e9f2a9d'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:38.783844 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40b20a8c16d4771b4410f975e9f2a9d'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:38.795638 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40b20a8c16d4771b4410f975e9f2a9d'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:38.796304 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40b20a8c16d4771b4410f975e9f2a9d'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:38.796907 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40b20a8c16d4771b4410f975e9f2a9d'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:38.809226 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1435/2878] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:48:38 2022] DELETE /identity/v3/users/d40b20a8c16d4771b4410f975e9f2a9d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:38.974752 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960c3e2-31a4-4977-92b5-965b519b90a2 service neutron] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:38.984543 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960c3e2-31a4-4977-92b5-965b519b90a2 service neutron] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:39.039832 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:39.040615 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:39.040898 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:39.041173 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] PATH_INFO: `/v3/projects/a516f78770624beba1baee79a4694c7a` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:39.042367 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a516f78770624beba1baee79a4694c7a)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:39.044516 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:39.091681 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a516f78770624beba1baee79a4694c7a', 'request_id': 'req-0d309237-b280-47ee-b6b8-90eca9d4fdc3'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.096596 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a516f78770624beba1baee79a4694c7a', 'request_id': 'req-0d309237-b280-47ee-b6b8-90eca9d4fdc3'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.104708 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a516f78770624beba1baee79a4694c7a', 'request_id': 'req-0d309237-b280-47ee-b6b8-90eca9d4fdc3'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.116261 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] The token cache is being invalidate because project a516f78770624beba1baee79a4694c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:48:39.116580 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.117230 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.118787 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1444/2879] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:48:38 2022] DELETE /identity/v3/projects/a516f78770624beba1baee79a4694c7a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:39.122902 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:39.125094 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:39.139345 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60240028-b19e-40c8-9bb1-4b012c590a38 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:39.194981 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:39.195838 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:39.196115 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:39.196385 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] PATH_INFO: `/v3/users/17be1d8d35dd4850865cb4f151fa0954` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:39.197544 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17be1d8d35dd4850865cb4f151fa0954)` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:39.199473 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:39.243237 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17be1d8d35dd4850865cb4f151fa0954'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.249772 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17be1d8d35dd4850865cb4f151fa0954'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.261526 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17be1d8d35dd4850865cb4f151fa0954'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.262198 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17be1d8d35dd4850865cb4f151fa0954'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.262828 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.notifications [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17be1d8d35dd4850865cb4f151fa0954'} {{(pid=79371) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.274711 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1436/2880] 10.222.0.79 () {58 vars in 1223 bytes} [Mon Feb 21 01:48:39 2022] DELETE /identity/v3/users/17be1d8d35dd4850865cb4f151fa0954 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:39.436365 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] Authenticating user token {{(pid=79370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:39.437930 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.fernet_utils [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:39.451731 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309237-b280-47ee-b6b8-90eca9d4fdc3 admin admin] Validating token access rules against request {{(pid=79370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:39.507735 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556ea52-fcec-451b-8da4-50305ceabe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100e11f767f7472887d51a9dc7231480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442aa4692fdc4c9cbacda48f2343b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:39.509007 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556ea52-fcec-451b-8da4-50305ceabe69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:39.509291 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556ea52-fcec-451b-8da4-50305ceabe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:39.509565 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556ea52-fcec-451b-8da4-50305ceabe69 admin admin] PATH_INFO: `/v3/projects/f8a08453469e481d8031583de4309abc` {{(pid=79370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:39.510807 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556ea52-fcec-451b-8da4-50305ceabe69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a08453469e481d8031583de4309abc)` {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:39.512721 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556ea52-fcec-451b-8da4-50305ceabe69 admin admin] RBAC: Authorization granted {{(pid=79370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:39.560475 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9556ea52-fcec-451b-8da4-50305ceabe69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a08453469e481d8031583de4309abc', 'request_id': 'req-9556ea52-fcec-451b-8da4-50305ceabe69'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.565893 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9556ea52-fcec-451b-8da4-50305ceabe69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a08453469e481d8031583de4309abc', 'request_id': 'req-9556ea52-fcec-451b-8da4-50305ceabe69'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.573592 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9556ea52-fcec-451b-8da4-50305ceabe69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a08453469e481d8031583de4309abc', 'request_id': 'req-9556ea52-fcec-451b-8da4-50305ceabe69'} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.584847 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9556ea52-fcec-451b-8da4-50305ceabe69 admin admin] The token cache is being invalidate because project f8a08453469e481d8031583de4309abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79370) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:48:39.585134 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9556ea52-fcec-451b-8da4-50305ceabe69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.585751 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: DEBUG keystone.notifications [None req-9556ea52-fcec-451b-8da4-50305ceabe69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79370) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:39.587287 dv-cinder-813229-6-iscsi devstack@keystone.service[79370]: [pid: 79370|app: 0|req: 1445/2881] 10.222.0.79 () {58 vars in 1232 bytes} [Mon Feb 21 01:48:39 2022] DELETE /identity/v3/projects/f8a08453469e481d8031583de4309abc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:51:20.749248 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] Authenticating user token {{(pid=79371) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:51:20.750673 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:51:20.882511 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91521cd-dcc1-4dbe-80b2-f8681aae3372 admin admin] Validating token access rules against request {{(pid=79371) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:51:20.937625 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde095f-9075-4ea8-bd57-93e44b22964e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02e7385005924d4f8c220c986b9866de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eaab085a52a4171be0afec37707daca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79371) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:51:20.938285 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde095f-9075-4ea8-bd57-93e44b22964e service placement] REQUEST_METHOD: `GET` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:51:20.938571 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde095f-9075-4ea8-bd57-93e44b22964e service placement] SCRIPT_NAME: `/identity` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:51:20.938847 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde095f-9075-4ea8-bd57-93e44b22964e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79371) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:51:20.940613 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.fernet_utils [None req-fdde095f-9075-4ea8-bd57-93e44b22964e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79371) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:51:20.951317 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde095f-9075-4ea8-bd57-93e44b22964e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:51:20.952876 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde095f-9075-4ea8-bd57-93e44b22964e service placement] RBAC: Authorization granted {{(pid=79371) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:51:20.962359 dv-cinder-813229-6-iscsi devstack@keystone.service[79371]: [pid: 79371|app: 0|req: 1437/2882] 10.222.0.79 () {60 vars in 1365 bytes} [Mon Feb 21 01:51:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)